Episode 26: What key technologies and tools do you rely on?

0:00 

So we look at it from across a spectrum of different, you know, maybe stacks of tools – databases, big data tools, dev-op tools, cloud platforms, and of course at the core of the programming languages. 

0:18 

So, a lot of, you know, key technologies that we rely on. Hive, Mongo, elastic are some of the databases that we’re leveraging. 

Big data tools, Spark is huge in our shop, airflow as an orchestration layer it and a big data tool in our shop. 

0:39 

Dev-ops tools, you know, Docker for deploying and for testing and for spinning up 

engineering components to be able to allow for the engineers to do the work that they’re doing of course GitLab for our source repository 

we have a pretty substantial footprint in cloud platforms we also have a private cloud as well where we do our processing 

1:03 

using you know kind of an EMR paradigm and then at a core you know our our programming language is heavy on good old SEQUEL but then you know Python, Scala, Java – 

1:15 

all of those programming languages are in use today by our shop.