Catawiki’s purpose is to enable people to discover and obtain special objects that help them fulfill their passions. In doing so, we add some color & make the world a more interesting place!
Our Data Story
With thousands of active lots every day, hundreds of thousands of daily bids, millions of users, and countless marketing campaigns, the Catawiki platform generates a vast amount of data every day. This data is being collected and stored in the Data warehouse, which is used extensively by our team of 5 analysts and data scientists. There are also hundreds of active internal users of our Web interface to the Data warehouse.
As Catawiki grows and produces more data, our Analysts would like to perform even more sophisticated analyses, our Data Scientists want more data, and yes, Product owners want more dashboards! With this in mind, Catawiki is building a new data platform using tools from the Hadoop ecosystem and the Google Cloud Platform that can accommodate the rapidly growing amount of data and requirements of analysts, data scientists, and product owners.
We have started streaming event data and writing data pipelines in Apache Airflow that transform this data with Apache Spark and on the Google Cloud Platform, and now Catawiki needs more Data Engineers to help us tackle the challenge of bringing even more data sources into our platform and transforming and organizing this data for analysis and consumption by other applications. It’s a big challenge but one that we’re really excited about solving.
Expand our current infrastructure and build scalable data pipelines using the Hadoop ecosystem and the Google Cloud Platform. You will work in cooperation with our Software Engineers, Platform Engineers, Data Scientists, and Product Owners to:
- Explore new ways of transforming and analyzing data and continuously expand and improve the performance of our data pipelines.
- Build prototypes, fast, and determine what their worth are in the business and within the infrastructure before iterating and improving them.
- Work closely with Data Scientists and Product Owners to decide how best to structure and store data in order to make it easily accessible to business users.
- Evaluate and develop highly distributed Data solutions; You will advance our data infrastructure and tool set to meet growing business requirements regarding performance and data-quality.
A Data Engineer who likes to experiment with and explore new tools and technologies. You will be familiar with tools in the Hadoop ecosystem including Airflow, Spark, Kafka or similar and cloud technologies, preferably with the Google Cloud Platform
You are a Data Engineer with experience in modern backend web technologies.
You know how to design and build low-maintenance, high performing ETL processes and Data Pipelines.
You can communicate an idea clearly on various levels of abstraction, depending on the audience.
Professional experience with SQL: reading, writing and optimizing complex statements.
As Europe’s fastest growing online auction platform, our mission is to make special objects available to everyone. In fact, 14 million users are buying and selling on Catawiki every month. This means we are continually growing and always on the lookout for new talent!
Born and raised in The Netherlands, we started in 2008 as a platform where collectors could manage their collections online. Yet, times change, ideas evolve, and in 2011 we hosted our first online auction and we haven’t looked back since! We’ve now grown to 450 Catawikians working across 7 international offices and are proud to have maintained our start-up mentality.
Here’s what we can offer you
A diverse and international team with over 40 different nationalities, located in the heart of Amsterdam and Assen with an easy-going atmosphere. The Catawiki Community gathers everyone together for everything from ‘CataFooty’ to International Food Festivals, Friday Drinks, Board Game Nights, Pub Quizzes and Boot Camps!
And there’s more! We also provide paid holidays, holiday allowance and a pension plan paid for by Catawiki.
Amsterdam or Assen