Cloud Data Engineer
Location: Belgium or The Netherlands
As a cloud data engineer you are responsible to deliver end-to-end data solutions, enabling your clients to make data-driven decisions based on your solution by collecting, transforming and publishing data.
You enjoy designing, developing, and maintaining robust data pipelines and data architectures in the cloud.
The impact you’ll make
By designing and implementing scalable data pipelines, ensuring efficient data flow and processing. You will optimize data storage, enable real-time analytics, and enhance data security. By leveraging a public cloud’s advanced tools, you facilitate data-driven decision-making, improve operational efficiency, and support business growth through insightful analytics and streamlined data management.
Your expertise drives impactful data solutions.
Your skills
- Design, develop, maintain and optimize data pipelines preferably on GCP or Azure
- Build and manage data warehouses and data lakes using GCP or Azure services like BigQuery and Azure Synapse Analytics
- Strong proficiency in cloud services such as Cloud Dataflow, Databricks, Cloud Pub/Sub and Azure scheduler.
- Expertise in SQL and experience with relational and NoSQL databases.
- Proficiency in programming languages such as Python, Spark, or Scala.
- Experience with ETL tools and frameworks
What's in it for you?
- Work with cutting-edge technology in the field of data engineering
- Stay current with the latest developments and best practices on the cloud
- Engage in continuous (peer)learning
- Participate on a tactical level within our company
- Enjoy an open and informal company culture
- Collaborate with awesome colleagues
Why Agiliz
We’re a team of about 35 people, all interested in data and analytics. Fun, informal and open communication define us. We’re like a small village where everyone knows everyone and we’re always willing to lend a hand to our neighbour.
We don’t limit ourselves to one technology or one business sector, the variety in projects and technology stack in addition to our knowledge sharing culture is one of the reasons why applicants choose for us.
Although we believe that our love for team events, food and good vibes might have something to do with it as well.
Meet your future colleague Axel
My role as a Data Engineer covers a wide range of responsibilities. It starts with gathering and analyzing business requirements, followed by diving into data sources to identify opportunities that meet those needs. I then move on to the process of extracting, storing, cleaning, transforming, and modeling the data. Additionally, I provide training and coaching sessions to ensure that end users can make the most of the data solutions.
I always go the extra mile for my clients and take pride in the robust data solutions I design.
Speaking of miles, one of my favorite activities is riding my motorcycle. I'm especially excited about my upcoming two-week road trip through Tanzania!
Meet your future colleague Casper
For my current project, I work on the Google Cloud Platform. Here I connect data from different data sources like Salesforce, MariaDB, etc. to bundle them in a modernized data warehouse. I build custom Spark ETL pipelines with DataFusion. With the Data Loss Prevention API, I encrypt sensitive data with keys to ensure security and privacy. To orchestrate these data pipelines, I use Cloud Composer (Apache Airflow). Event-triggered functionality is handled by serverless Cloud Functions and object storage in Cloud Storage. I also make technical dashboards that monitor the components and their costs in Data Studio. In the end, the data is stored in a Kimball data warehouse model in BigQuery where the data is consumed by MicroStrategy reports.
In my downtime I like to go to the movies and go cycling to train for the company’s yearly bike event. We are going to Italy for the Duchennes Heroes event, 3 days of cycling with my colleagues while supporting a good cause.