Seeking a Data Engineer with experience in ADLA, ADF,SQL Server, Azure, Data Lake and SSAS. This position will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Gathering, Application Architecture definition and Design; play an important role in creating the high level design artifacts; deliver high quality code deliverables for a module, lead validation for all types of testing and support activities related to implementation, transition and warranty; be part of a learning culture, where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is respected and valued.
1. Gather Business Requirements and build Data architecture.
2. Design, build, deploy, maintain and troubleshoot data aquistion processes.
3. Develop and monitor ETL/ELT processes in data pipelines.
4. Identify ways to improve data reliability, efficiency and quality.
5. Conduct research for industry and business questions and update stakeholders.
1. Education: Describe the years and type of experience typically required.
• Bachelor’s degree in Computer Science.
• If degree is not in computers but has relevant experience and certificate on Azure and Microsoft SQL that will do as well.
2. Experience: Describe the years and type of experience typically required.
• 4 years plus active experience in SQL development in MS SQL Server.
• 1 year plus active experience ETL/ELT in data lake.
3. Knowledge and Skills: Describe any knowledge, skills, or technical expertise needed.
• Demonstrative ability to develop complex T-SQL, Store Procedures, Functions, Triggers….etc.
• Basics of SQL Administration, SSIS, ADF, Integration using REST API and SQL.
• Demonstrative ability to process data in Python, Spark.
• Working in Cloud Environment management such as Azure, AWS, etc.
• Working with medallion architecture in Data Warehouse/Data Lake project lifecycle, tools, technologies, best practices.
• Knowledge of Data Modeling concepts, designs and techniques.
• Strong ability to problem-solve, troubleshoot, and apply root cause analysis.
• Excellent communication, analytical and desire to work in a highly collaborative environment.