Large Data Matters

Twitter to open source Hadoop-like tool

Ambrish Choudhary — Sat, 06 Aug 2011 06:09:43 +0000

Twitter says it is planning to open source Storm, its Hadoop-like real-time data processing tool. In a blog post Thursday, the microblogging network said it plans to release the Storm code on Sept. 19 at the Strange Loop event in … Continue reading →

NoSQL standouts: New databases for new applications

Ambrish Choudhary — Mon, 01 Aug 2011 18:46:16 +0000

Cassandra, CouchDB, MongoDB, Redis, Riak, Neo4J, and FlockDB reinvent the data store

Read here.

NoSQL is a Premature Optimization

Ambrish Choudhary — Sat, 23 Jul 2011 12:19:50 +0000

In this post author argues NoSQL is a premature optimization and should be considered when really needed. Relational DB can handle load required in most of the cases.

Read full post here

LexisNexis open sources Hadoop challenger

Ambrish Choudhary — Thu, 16 Jun 2011 05:05:31 +0000

A super-computer architecture that crunches big data for banks, police, and spooks will soon be open sourced as a super-fast alternative to the Googlesque Hadoop.

LexisNexis Risk Solutions is opening up its High Performance Computing Cluster (HPCC), a system written in C++ that it claims is four-times faster than Hadoop when running data-intensive queries on ordinary Linux servers.

Source

Scalable SQL

Ambrish Choudhary — Tue, 31 May 2011 13:28:03 +0000

How do large-scale sites and applications remain SQL-based?

Source

Spotify – Large Scale, Low Latency, P2P Music-on-Demand Streaming

Ambrish Choudhary — Mon, 30 May 2011 13:03:40 +0000

Spotify is a music streaming service offering lowlatency access to a library of over 8 million music tracks. Streaming is performed by a combination of client-server access and a peer-to-peer protocol. In this paper, we give an overview of the protocol and peer-to-peer architecture used and provide measurements of service performance and user behavior. The service currently has a user base of over 7 million and has been available in six European countries since October 2008.
Data collected indicates that the combination of the client-server and peer-to-peer paradigms can be applied to music streaming with good results. In particular, 8.8% of music data played comes from Spotify’s servers while the median playback latency is only 265 ms (including cached tracks). We also discuss the user access patterns observed and how the peer-to-peer network affects the access patterns as they reach the server.

Full Article

NoSQL and Problems in RDBMS

Ambrish Choudhary — Thu, 26 May 2011 07:47:49 +0000

Read this interesting article here.

A day in the life of a slow page at Stack Overflow

Ambrish Choudhary — Tue, 03 May 2011 04:28:44 +0000

This post walks through the internal process of tuning a particular page on Stack Overflow.

** Source

Scalable SQL

Ambrish Choudhary — Thu, 21 Apr 2011 08:43:19 +0000

SQL is actually the name of a declarative query language, while more precisely this article concerns traditional relational database systems. Since it is common to talk about NoSQL as the opposite of relational database systems, we have taken the editorial liberty of using SQL as a synonym for relational database systems.

Read full article here.

The Power of R: More Companies Using Language for Business Analytics

Ambrish Choudhary — Thu, 07 Apr 2011 10:53:46 +0000

R is an open source statistical programming language. The easiest way to think about it is the largest commercial competitor in the states is a company called SAS, and while it’s not a perfect analogy, one way to think about R is as an open source version of SAS. It’s not perfectly correct, but for people who have not heard of R, that’s one way to explain it.

It’s used to analyze data – any kind of data that exists. That’s really why R is becoming so popular

** Source **