Scrape and download pdf files from google or bing using PowerShell

Originally posted on Teusje:

Here is a very simple script that you could execute using PowerShell ISE. It could probably be written much better, but it works. The script just uses the power of the google search engine by searching for a specific filetype. This should also work with the Bing search engine.
To make the script work, make sure you have a directory C:tempdwnld created. Also you could easily change the regular expression pattern and the keywords.

Comments with modifications on the scripts are always welcome ;)

Enjoy ;-)
Don’t forget, web scraping can be illegal! Use it with care!

View original

Discovering, Capturing, and Cleaning Online Data with Power Query for Excel

Discovering, Capturing, and Cleaning Online Data with Power Query for Excel.

Don’t Hire A Chief Data Officer Unless You’re Serious About Becoming A Data-Driven Company

Originally posted on TechCrunch:

[tc_contributor_byline slug=”ben-werther”]

There’s a lot of discussion in the business world right now about chief data officers (CDOs). It’s centered primarily around two questions: When should a business hire a CDO? And, What should this person do?

No organization should seriously consider hiring a new C-level executive without fully understanding the strategic purpose of that role. Yet that’s exactly where many companies are today: They have come to realize that data is a critical business asset, and they’re not managing it effectively. They are desperate to have someone swoop in, take control of everything data-related and make it all better.

This approach is wrongheaded. The CDO should not be expected to assume the entire “data problem” for an organization. If you think differently, you’re not ready to hire a CDO.

How will you know if you are ready? When your business is prepared to execute a formal big-data strategy and…

View original 636 more words

Hooks, The App That Lets You Get A Notification For Almost Anything, Lands On Android And Apple Watch

Originally posted on TechCrunch:

Hooks, the app that sends you push notifications triggered by things that are important to you, has a new version for Android, as well as the now almost obligatory Apple Watch app. Previously, the latest version of Hooks was iOS only.

Apple’s smartwatch platform seems particularly suited to a service that lets you pick from 100 or so ‘channels’, consisting of 1 million-plus user created alerts, to keep you updated on anything from the latest tweet, news article or sports score, or something more specific such as a change in stock price or the current bitcoin exchange rate.

In a sense, smart watch trailblazer Pebble was built on this premise — serving as a companion to your smartphone and offering at-a-glance access to important notifications. I actually know of someone who has two Pebble watches, one for work and one for home, for this very reason. Apple’s…

View original 155 more words

Sports Data and R – Scope for a Thematic (Rather than Task) View? (Living Post)

Originally posted on OUseful.Info, the blog...:

Via my feeds, I noticed a package announcement today for cricketR!, a new package for analysing cricket performance data.

This got me wondering (again!) about what other sports related packages there might be out there, either in terms of functional thematic packages (to do with sport in general, or one sport in particular), or particular data packages, that either bundle up sports related data sets, or provide and API (that is, a wrapper for an official API, or a wrapper for a scraper that extracts data from one or more websites in a slightly scruffier way!)

This is just a first quick attempt, an unstructured listing that may also include data sets that are more generic than R-specific (eg CSV datafiles, or SQL database exports). I’ll try to keep this post updated as I find/hear about more packages, and also work a bit more on structuring it a little…

View original 844 more words

Quip, The Mobile-First Word Processing App, Adds A Desktop Version

Originally posted on TechCrunch:

When Quip was first debuted to the world in two years ago by its co-founder, former Facebook CTO Bret Taylor, its unique selling point was that it was a “mobile first” word processor, built for the always connected, always collaborating smartphone and tablet generation. Fast forward to today, and things are evolving — or taking a step back, depending on how you look at it: The startup is releasing its first official desktop apps for Mac and Windows.

It’s a somewhat ironic turn, given that when he was first launching Quip, Taylor mocked legacy word processing programs, noting that “It’s comical how similar [MacWrite] looks like what we use today” and how most desktop programs don’t address how consumers are turning away from legacy computing devices.

So why the change of heart? Quip is following its users.

Quip today has over 30,000 businesses and “millions of individuals” using its apps, including companies like Facebook…

View original 460 more words

Microsoft Writes Down $7.6B Of Its Nokia Acquisition, Announces 7,800 Layoffs

Originally posted on TechCrunch:

Microsoft’s signaled and expected goodwill impairment, relating to its previous purchase of the majority of Nokia’s hardware assets, took place this morning — with the software company erasing $7.6 billion from its books.

The firm’s efforts to elbow into first-party hardware have therefore received a massive setback, writing down the vast majority of the purchase price of its phone business. The company has also announced 7,800 layoffs “primarily in the phone business”, and a roughly $800 million restructuring charge. Microsoft declined to comment on the number of remaining staffers it employs as a result of the Nokia deal.

The deal with Nokia, originally pegged at $7.2 billion, did not, it seems, take into account certain amounts of cash and intellectual property. At the same time, that Microsoft has managed to write down more than the originally announced purchase price of the assets in question is somewhat humorous.

So that’s all gone. Microsoft’s phone…

View original 225 more words