NIX, a global supplier of software engineering and IT outsourcing services, is looking for a Medior Data Engineer (Scala/Python) in its office in Budapest (Vaci Greens, 13th district). You’ll be part of a team of professionals who are ready to find the best tailor-made IT solutions for their multinational clients in various industries and solve complex problems.
RESPONSIBILITIES:
- Collaborate with product owners, data scientists, and cross-functional teams to design and implement data processing features for both batch and real-time use cases.
- Build and maintain scalable data pipelines and architectures to extract, transform, and load data from diverse sources (APIs, data streams, data lakes, and databases).
- Ensure compliance with data privacy and security standards.
- Monitor and anticipate trends in both batch and streaming data engineering, proposing improvements aligned with business goals.
- Share knowledge and provide technical guidance to other teams.
- Evaluate and implement the right tools and strategies depending on project requirements (batch vs. real-time).
WHAT WE EXPECT FROM YOU:
- 4+ years of commercial experience in data engineering.
- Strong programming skills in Scala or Python (experience in both is highly desirable).
- Solid knowledge of distributed computing approaches and technologies (e.g., Spark, PySpark, Spark Streaming, Akka Streams).
- Hands-on experience with at least one cloud platform (AWS, GCP, Azure) and its data services.
- Strong SQL skills, including query tuning.
- Understanding of data warehousing principles and modeling concepts (OLTP/OLAP, SCD, dimensional modeling, star/snowflake).
- Proficiency with relational databases (PostgreSQL, MSSQL, MySQL).
- Experience with orchestration tools (Airflow, Prefect, Glue, Data Factory) or streaming platforms (Kafka, Flink, Kinesis).
- Strong team collaboration and communication skills.
- English level B2+.
WILL BE A PLUS:
- Experience with stream processing frameworks (Kafka Streams, AWS Kinesis, Spark Streaming, Flink).
- Knowledge of SQL/NoSQL storage design principles.
- Experience with modern data warehouses (Snowflake, Redshift, BigQuery).
- Advanced knowledge of Spark internals (performance tuning, optimization).
- Experience with data lakes and lakehouses (Azure Data Lake, Iceberg, Hudi, Delta Lake).
- Familiarity with containerized (Docker, Kubernetes, ECS) or serverless (Lambda) environments.
- Knowledge of popular data formats (JSON, Avro, Parquet, ORC, ProtoBuf).
- Exposure to data science or ML workflows.
WHAT WE OFFER:
- Competitive compensation packages.
- Stable employment, based on a full-time employment contract.
- Private health insurance (Medicare Сlinic).
- AYCM sport pass, providing discounts at various sports facilities in Hungary.
- Interesting tasks and diverse opportunities for developing your skills.
- Free training courses, including English.
- Participation in internal and external thematic events, technical conferences.
- A spacious office in the heart of Budapest (13th district).
- All necessary devices and tools for your work.
- Friendly, motivating atmosphere.
- Active corporate life.