Location: Poland
Rate: 21000 pln gross
SKILLS SUMMARY
Technical Skills:
- SQL Tuning
- ETL
- Data Warehouse
- Bash
- Data Integration
- Data Orchestration
- Big data/Hadoop/Impala/Hive
- Kafka
- Python
- Snowflake
Professional Experience
Position: Team Lead, Data Engineer
07.2018 – Present
Responsibilities:
- Managed a team of 5 data engineers, on boarded and helped new employees
- Initiated and maintained:
optimized impala env and created sql monitoring
real time data pipelines for hadoop
made architecture of wizard for some type integration
selection and monitoring of data storage format
automation, monitoring, triggers for internal processes
collection of metadata.
- Supported 50+ customers (analytics, developers, data science)
- Configurator, maintained, and oversaw 3000+ automated and scalable ETL/ELT data jobs
- Optimized 200+ non performant queries, and pipelines (ETL process decreased from 14 to 6 hours)
- Created educational materials
- Resolved a lot of incidents
Tools & Technologies: Jenkins, Bash, Python scripting, Oracle, SQL, Snowflake, Streamsets, Tidal, Airflow
Position: DevOps
April. 2015 July 2018
Responsibilities:
- Developed and maintained automated CI/CD pipelines using Jenkins
- Provisioned Servers and deployed features using Ansible
- Deployed a Hadoop cluster of Cloudera (hdfs, yarn, hbase, zookeeper, kafka)
- Duty 24/7
Tools & Technologies: Hbase, Kafka, Hadoop, Bash, Ansible, Zabbix, Grafana, Git, Docker, Jenkins
Position: Senior Data Engineer
08.2013 – 04.2015
Responsibilities:
- Participated in the development of the architecture of DWH
- Created pipeline automation and orchestration
- Created a team of data engineers of DWH
- Duty 24/7
Tools: Jenkins, Bash, Oracle, SQL
