Big Data Engineer
Our Take
Build and optimize big data pipelines for network and marketing analytics at BITĖ.
What you’ll do
- Ensure data quality and integrity
- Implement data governance best practices
- Collaborate on implementation solution plans
- Monitor and improve data system performance
- Optimize for speed, reliability, scalability
What they’re looking for
- 3+ years data engineering or equivalent technical experience
- PySpark and Python proficiency
- ETL design and data modelling with Apache Airflow
- SQL databases, HDFS, ClickHouse, and Elasticsearch
What you get
- Unlimited calls, SMS, data
- 5G mobile router
- Go3 + Netflix subscription
- Health and accident insurance
- Tier III pension accumulation
- Flexible hybrid setup
- Workation options
- Gross salary 3000 - 4200 EUR/month
Skills & Focus Areas
- PySpark
- SQL
- Apache Airflow
- Python
- ClickHouse
- HDFS
- Elasticsearch
- data modeling
As posted by Bite
We are a technology company with 💚
We nurture warm, respectful relationships every day and create an environment where it feels good to grow. Join us and work with a team that supports and inspires you to achieve more.
This role focuses on innovation, technical proficiency, and collaboration to deliver advanced solutions that fulfill our requirements. You will join a diverse team of data engineers skilled in network, finance, and marketing data. They are adept at analyzing, structuring, and recommending optimal solutions for data that aligns with our business needs.
Your main task will be:
Ensure data quality and integrity through data governance best practices, including validation, transformation, and security protocols, using technologies such as PySpark, Impala, Hive, HDFS, ClickHouse, Zabbix, and Airflow
Collaborate with the project management team to develop the overall implementation solution plan and actively contribute to project life cycle phases, leveraging technologies like PySpark and Airflow
Continuously monitor and improve the performance of data systems to ensure they are optimized for speed, reliability, and scalability, utilizing technologies like PySpark and HDFS
Job Requirements
3+ years of data engineering or similar technical experience
Knowledge of SQL, Data modelling architecture and ETL processes with tools such as Apache Airflow
Proficiency in PySpark, Python, Linux, HDFS, Elasticsearch, ClickHouse, and various SQL databases
Experience with AWS and NiFi is a plus
Strong analytical and problem-solving skills
BITĖ offers the following benefits:
Have freedom to implement best ideas
Personal phone with unlimited calls, SMS, and data
5G mobile router for your home or travels
Go3 + Netflix subscription for your downtime
Comprehensive health and accident insurance
Tier III pension accumulation plan
Flexible hybrid setup: 4 days in our Vilnius office, 1 day remote
Workation options and flexible working hours
Themed company events, engaging team activities, and a fun, modern work culture
Gross salary 3000 - 4200 EUR/month