Apache Spark - Can it be lupus?
Hmm...so you're trying to diagnose problems in your Spark Job and can't seem to make progress? I've been there. Working with Spark is similar to working wit...
engineering
Monolithic Repo vs Micro Repos
Recently, I have been working with a single repo which had the entire codebase of the company. It was basically a hierarchial maven project with each service...
Interesting Papers from Cloud & Big Data
One of courses that I took in Columbia, with a really good course content, was Cloud and Big Data. I took the course in Fall '14 and TA'ed it in Spring '15....
Using Multiple Heat Layers with Google Maps
For one of the assignments in Cloud & Big Data course at Columbia University, we had to display a Heat Map Layer showing positive and negative tweets fro...
MariaDB seconds behind issue fixed
We (my friend Vishnu and I) had reported a bug with MariaDB 10.0.4. Just got an update that the issue is fixed now! Here are the details about the bug: We ha...
Slash n is back!
Mark your calendar, folks. Come March 7, 2014, Flipkart's technology conference is back and it's bigger than ever. This year’s slash n theme is ‘Intelligence...
Serving static content with Dropwizard
Dropwizard, in its own words is a "Java framework for developing ops-friendly, high-performance, RESTful web services". It is extremely lightweight, stable a...
MySQL Partial Replication
A couple of folks have asked me to elaborate more on partial replication. What is the use of replicating only certain tables? Can you add/remove tables/db to...
Mysql Replication from an existing slave
So you want to add another slave to an existing mysql replication environment? There are multiple ways to do this. First option, as mentioned in the mysql ...