Long-running Transactions: If trains shared the roadsImagine a bustling city, with two primary modes of transportation: trains and cars, with one catch: the trains also share the same roads…Aug 25, 2023Aug 25, 2023
Data Access between Micro/ServicesAs any product switches to a microservices or multiple services (big or small) model, one key challenge to figure out is which service owns…Feb 8, 2022Feb 8, 2022
Kafka JDBC Connector with Aurora PostgreSQLJDBC Connector is pretty straight forward to configure and relies on standard SQL, so following steps should apply to almost all database…Sep 9, 2021Sep 9, 2021
PostgreSQL Debezium/CDC Kafka Connector with Aurora RDSThis post uses Confluent based Kafka cluster and Kafka Connectors. Same steps will be applicable to Kafka Connect hosted by you or any…Sep 9, 2021Sep 9, 2021
Recommender Systems: Quick Introduction<Few years ago, I finished the famous Andrew Ng Machine Learning course. Following notes are from the lecture on Recommender systems…Jul 9, 2021Jul 9, 2021
Fixing Hotkey Issue in Redis ClusterRedis is extremely fast but there are occasionally you can push your node beyond its limits. When some key/values are used across many…Jan 22, 2020Jan 22, 2020
Batch Your DB QueriesWhile working in a high level language, we get so carried away that we start to query our RDBMS in object abstractions. It works for the…Jan 14, 2020Jan 14, 2020
Aws Lambda: different parameters for the Rest api call vs using from aws consoleI recently wasted many hours while trying to debug this. it boils down to the input deserialzation. The function which was working fine…Sep 9, 2019Sep 9, 2019
Efficiently Splitting Secondary Index Across ShardsIn Big data systems, where data is distributed across many machines, uniform distribution and colocation (e.g. on same partition or host)…Aug 30, 2019Aug 30, 2019
Solr: Improving performance for Batch IndexingFew months ago, I worked on improving performance of our ‘full’ indexer. I feel that the improvement was significant enough to share the…May 10, 20181May 10, 20181
