Senior Python Data Engineer

Introduction

Our partner is one of the largest ICT consulting conglomerates, solving outstanding challenges with the power of digital technology for various industries. Their dynamic growth is enabled by their commitment to customer-centricity and industry expertise, with over 450,000 employees worldwide.

Tasks

Collaborating with cross-functional teams to understand data requirements, and design efficient, scalable, and reliable ELT processes using Python and DataBricks
Developing and deploying ELT jobs that extract data from various sources, transform it to meet business needs, and load it into a Snowflake data warehouse
Taking ownership of the end-to-end engineering lifecycle, including data extraction, cleansing, transformation, and loading, ensuring accuracy and consistency
Creating and manage data pipelines, ensuring proper error handling, monitoring and performance optimizations
Developing and maintain tooling and automation scripts to streamline repetitive tasks
Maintaining documentation, including data flow diagrams, technical specifications, and processes
Working in an agile environment, participating in sprint planning, daily stand-ups, and retrospectives
Conducting code reviews, provide constructive feedback, and enforce coding standards to maintain a high quality
Participating in architectural design discussions and help shape the future of our data infrastructure encompassing data warehouses and lakes

Expectations

Proficiency in Python programming, including experience in writing efficient and maintainable code.
Hands-on experience with cloud services, especially DataBricks, for building and managing scalable data pipelines
Proficiency in working with Snowflake or similar cloud-based data warehousing solutions
Hands-on experience using Linux operating systems
Solid understanding of ELT principles, data modelling, data warehousing concepts, and data integration best practices
Experience with writing efficient SQL queries
Familiarity with REST APIs and other integration techniques
Meticulous attention to detail and a passion for problem solving

Advantageous

Familiarity with data visualization tools and libraries (e.g., Power BI)
Background in database administration or performance tuning
Familiarity with data orchestration tools, such as Apache Airflow
Previous exposure to big data technologies (e.g., Hadoop, Spark) for large data processing

Employer's offer

Our partner has been delivering services from Hungary since 2001, making them a perfect choice if you are looking for stability
They offer a wide range of benefits, including a market-leading comprehensive private healthcare package
They offer a wide range of self-development opportunities: their colleagues have access to a variety of training opportunities for their personal and professional development
Our partner also offers numerous career opportunities for those who like to challenge themselves in different areas and try themselves in other positions
You will be part of a global and diverse work environment with relaxation areas, terraces, and a friendly atmosphere
With us, you can participate in company events, hobby clubs, and sporting events
An attractive benefits package awaits you