Feature Store is the data powerhouse of any Machine Learning Ecosystem.
Firstly let’s establish some prevalent terms in the ML world.
So what does an ideal feature store do? …
Configuring your username and password for connecting to a remote client from Jenkins is easy. But how would you configure a proxy/group id for authentication to remote clients from Jenkins. It does not typically have a password(or atleast the password is managed only by admins)
This script basically consumes a databasename and tablename as an argument and gets the hive data of the table into a CSV in a local file.
Line 1–2 : Getting command line arguments for database name and table name.
Line 3 : Getting the username of the current session so that we can write the CSV to the user’s local folder later.
Line 5–6 : Making sure we have received both database name and table name from the user.
Line 7–8 : Cleaning up existing HDFS folders and local folders from previous writes.
Line 11 : Executing an hive…
It’s one of those things that you almost know.
If you are looking at this article, you are like me. You have done this before. You thought this was so easy that you didn’t care to note it anywhere. But when the time came and you had to do this again — BLANK. Think of bits of tech thats we think is easy, but is not actually easy to remember. No matter how much you dig you cannot fully retreive it.
These articles that I am going to write are going to be 1 or 2 min reads of tech…
Getting your own Cassandra environment setup with open remote connections on Openshift can be achieved in 3 steps:
Note: The dockerfile and scripts used below can be found on github here.
A line-by-line explanation of the below Dockerfile is in order :)
Line 1: This Dockerfile uses the base image of the most stable version(3.11.8) of Cassandra from Docker hub
Line 3–4: I have updated the…
This article advises on what features an ideal dashboard should have. This way one can build the right observability platform to envision the right metrics for your customer.
However, before you start thinking about what platform you want to build, I advise you to evaluate what you want to see and then tailor the platform to suit those needs.
What can we visualize:
There are three main elements that can be visualized on any dashboard:
It makes inherent sense to become good at doing something you know. But how can you be good at something you don’t know?
First of all, let me convince you why you need to excel at something you are unfamiliar at. In our day-to-day jobs, we are posed with things that are new. The situation demands you to do it whether you like it or not. In my opinion, it is better to put a positive spin on it rather than do it for the heck of it. Here’s how you make something constructive than being a drag.
Read this if your data platform 1.0 was not successful as you thought it would be.
Over 7 years of my career, I have been closely working on different aspects of building a data platform. It was called Data Lake, Data Swamp, Data Supply, Data Factory and so on. As cool as the terms were, did it actually deliver cool results is a million dollar question. Data is produced abundantly and there is no one way to house it right and derive value out it. …
This 5 min quick search was on a comma separated data file to help me sift through the data in seconds or less.This article covers a very basic setup, loading and querying of data from Solr.
Solr is a text-based search engine that you can use to index anything. It is built on the Apache Lucene project. It is also open source. The simple plug-and-play project can be used on any operating system. This takes away the havoc of a formal installation process.
There are a lot of buzz words in the Solr world. …
Leadership can be situational than hierarchical. Learning to deal with it the right way can take your career and you as a person, to the next level.
I have a mentor whom I always bug when I have a crisis — be it work, career or even personal life. This person would listen to me patiently until I come to pause and then ask me — “So, What do you want?”. It’s an easy question. I could have asked this question to myself. I do not need this person to ask me such a stupid question. Honestly, when you are…