Data Engineer (Food and Beverage Manufacturing)

Coherent Solutions is a digital product engineering company focused on empowering business success. Our global team of 2000+ talented professionals collaborate seamlessly to deliver innovative solutions that drive measurable business impact. Headquartered in Minneapolis, USA, the company’s core competencies across 10 locations worldwide include product software development, IT consulting, data and analytics, machine learning, mobile app development, DevOps, Salesforce, and more.

We grow a team of advisors, not just order takers, and strive to make the company a place for career growth and opportunities. If you want to grow your core competencies, share your passion and be sure that every contribution is evaluated, we are on the same page.

Company Background

The customer holds a top position in the food and beverage sphere. As a global player with operations across five continents and with annual sales of more than $7 billion, they partner with leading retailers, restaurants, and distributors.

Technologies

• Azure Databricks
• PySpark
• SQL
• Azure Data Factory
• Azure Data Lake
• Azure SQL DW
• Azure SQL
• Python

What You’ll Do

• Develop a comprehensive technical plan for the migration, including data ingestion, transformation, storage, and access control in Azure’s Data Factory and data lake;
• Design and implement scalable and efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databricks;
• Developing scalable and re-usable frameworks for ingesting of data sets;
• Ensure data quality and integrity throughout the entire data pipeline, implementing robust data validation and cleansing mechanisms;
• Working with event based / streaming technologies to ingest and process data;
• Stay up to date with the latest advancements in cloud computing, data engineering, and analytics technologies, and recommend best practices and industry standards for implementing the data lake solution;

Job Requirements

• 8 to 10 years of IT experience;
• Experience working with Azure Databricks;
• Familiarity with PySpark;
• Mastery of SQL;
• Knowledge of components: Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure SQL;
• Experience with Python programming language used for data Engineering purpose;
• Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows;
• Experience in data visualization/exploration tools;
• Strong problem-solving skills and the ability to translate business requirements into actionable data science solutions;
• Excellent communication skills, with the ability to effectively convey complex ideas to technical and non-technical stakeholders;
• Level of English – from Upper-Intermediate (written/spoken);

What Do We Offer

• You will be rewarded with the salary starting from 3400 EUR gross monthly.
• Remote work. We respect each employee’s chosen way to work remotely anywhere.
• “Launch for success” package: premium health insurance, monthly lunch vouchers, telecom services for employees and their family members, and more.
• Global teams. The working model in the company is based on working in global multicultural departments and gaining experience from the highest-level professionals.
• International Clients. It is on us to ensure the wide range of Clients you will work with – Innovative start-ups and Fortune 1000 companies in the U.S. and Europe.
• Professional growth opportunity. We created a professional training center including educational programs for developers of any level and live training sessions.
• Unique ideas development. Our internal start up incubator, Innovation Sandbox, helps to materialize ideas, receive support on their realization, and win cash prizes.
• Team spirit. Work in the company is not just about work – team building, celebrations, corporate events, family events and other traditions are an essential part of our culture.
• And much more Why Coherent Solutions is a company to work with https://www.coherentsolutions.com/careers/lithuania/benefits/.

Please take you time to see Coherent Solutions Privacy Policy for Job Applicants for details on how we process your personal data: https://www.coherentsolutions.com/privacy-policy-for-job-applicants