Posts Tagged ‘Big Data’

Could Israel Lead The Data Science Revolution?

October 13, 2012
Tel Aviv Yarkon River Kayaking

Tel Aviv Yarkon River Kayaking

Israel has an enormous potential to play a major role in the new “Big Data” and Data Science ecosystem. Data Scientist is becoming a very “sexy” profession and since “Big Data” is expected to create a huge market, the opportunity should not be missed.

Israel’s has the following advantages:

  • A World class academic activity in machine learning , pattern recognition & text analytics. Some example are: Prof. Yishay Mansour , Prof. Naftali Tishby ,Prof. Yair Weiss and Prof. Amnon Shashua.
  • Large supply of candidates – there are quite a lot of great PhD or MSC graduates in Applied math, Statistics  Physics , Biology, Bioinformatics and Chemistry . Since the universities have a very limited supply for tenures, the pool is quite deep. In Europe and US there is shortage of these skills.
  • These are not new topics For the Israeli Intelligence community and broader Israeli security sector. There are experienced experts who built proven,production systems. The experts are not only on the math side, but also on the business analysis side.
  • Typical Israeli data scientist has more IT\programming skills. While these are not mandatory features for success,they tend to accelerate the discovery process and add a lot value.
  • There are quite a few business applied Data Mining companies in the commercial sector and in start-ups arena (e.g. Pursway).
  • The excellent communication skills, domain understanding and language diversity , especially compared to classical never-worked-outside-of-university PhD. Many Israeli PhD are “forced” to work in teams and in the industry to make a living, or during their army service, so even the more introvert types make a solid team player 🙂
  • 50% reduced cost compared to US – for various historical reasons the PHD\Masters title is not as economical as in the states. An amazing Java developer with no degree at all would probably earn twice as much as an amazing chemistry POST-Doc from Harvard. While this is a shame, it presents an opportunity for Data Science service out of Israel. Moreover, there are less hedge-funds to waste people talent 🙂

There are various directions to capitalize the potential:

  • Providing Data Scientists as a service, out of Israel. While remoteness presents some challenges, we have seen early success. It seems that the pros outweigh the cons.
  • Build infrastructure products for Big data – around Hadoop, Hive, Mahoot etc. Adding the enterprise features and improving performance  These are similar in nature to traditional Israeli expertise in networking, storage and security. In my opinion, there is higher chance for na Israeli start-up to succeed here, bigger than in a new social application.
  • Develop innovative services that use Machine Learning internally to gain a competitive edge (In advertisement, Retail or Medicine)

In a world where “old-fashioned” software engineers are more and more common, each one of these direction can help maintain Israel’s Hi-Tech uniqueness.

P.S

I just saw that other people also think Israel has the chance to be a world leader in big data . Although the quote is from EMC, I knew nothing about it 🙂

Tel Aviv Bicycle Race Sukkoth 2012

Tel Aviv Bicycle Race Sukkot 2012

Can You Make Money Writing Algorithms? – Part III

April 21, 2012

“Money For Nothing and the (K) Nearest Neighbors Are Free”Doctor Mark Knopfler

In 2007 I wrote Why it is hard to make money form algorithms and How new technologies allow making money from algorithms.

Kaggle is a fascinating example:

Kaggle is an innovative solution for statistical/analytics outsourcing. We are the leading platform for predictive modeling competitions. Companies, governments and researchers present datasets and problems – the world’s best data scientists then compete to produce the best solutions. At the end of a competition, the competition host pays prize money in exchange for the intellectual property behind the winning model.

The biggest challenge right now is for $3M , to improve the broken American health care system 🙂 with 951 teams competing at this stage.

If we want to go for higher numbers: google paid $12B for Motorola patents. Most of these patents have probably never been used and are not-so-important-or-smart.

While I believe most software patents are idiotic, this is how the game is played these days. And in some sense it is encouraging that Intellectual property, in the form of Algorithms starts showing its economical value.

And the people with skills are doing well. From  “Big Data Skills Bring Big dough” in GigaOm

If you can claim to be a data scientist and have the chops to back that up, you can pretty much write your own ticket even in this tough job market. A quick search of the popular job posting sites –Indeed.com,SimplyHired.com, or Dice.com – shows a huge demand for data scientists or anyone who can demonstrate other “big data”skills.

And , most importantly, the funniest show in TV right now (except for Fox News) is Big Bang Theory, focusing on Algorithms to making Friends.

The German version is even funnier

Interesting News in Biology and Healthcare

November 5, 2011

BioHackers - discover Magazine