Senior Data Engineer IC Role Jobs in Bangalore at Sampoorna Consultants Private Limited

Last Updated: Aug 15, 2021 05:10 IST


Company Name
Sampoorna Consultants Private Limited
Job title
Senior Data Engineer IC Role
10-13 Years
Not Mentioned

Job Profile

Job Description

Designation: Senior Data Engineer

Overall 10+ Yrs with 5+ years of relevant exp in Azure Data Factory experience (AWS/GCP does not count).
This is a core, hands-on, Individual Contributor role. This is not an architect or a Team Lead role. (Of course, have to work within a team and with other teams).


? As part of a distributed Data Engineering team, provide technical leadership in development and continual improvement of ADF pipelines and Data Services.
? Hands on experience in Azure Data Factory (ADF) in-

? Authoring and designing Mapping Data Flows-
? Mapping Data Flows Expressions
? Know how to debug a data pipeline and identify issues and fix them.
? Operationalizing Mapping Data Flows
? Azure Integration Runtime
? Data Dedup
? Optimizing data flows.
? Hosted IR Patterns
? Private Endpoints
? Mapping Data Flows
? Wrangling Data Flows
? Configuration
? Use Cases

? Metadata Driven Pipelines-
? Expressions
? Dynamic Pipelines
? Orchestration Framework

? Monitoring Alerting Security-
? Logging Kusto Queries
? Alerting
? Roll Based Access
? Using Azure Key Vault

? Pricing & Limitations-
? Data Integration Units
? Data Flow Compute
? Wider Platform Orchestration & Cost Control
? Resource Limitations

? CI/CD with Azure DevOps-
? Source Control vs Developer UI
? ARM Template Deployments
? Power Shell Deployments

? Data Factory in Production-
? Testing
? Bootstrapping

? Excellent knowledge of Azure Cloud platform services stack and certified in Azure Data Engineer Associate Certification: DP-203 or (DP-200 AND DP-201).
? Experienced migrating CSV's, JSONs, SQL DBs to cloud using ADF Integration Runtime or SFTP or FTP or migrating (redesigning) completely from another DB to ADF.
? Solid knowledge of SQL, Python, PySpark, Shell Scripting (Power Shell), Azure streaming & Log Analytics
? Basic understanding of Azure DevOps pipelines and orchestration.
? Use PowerBI to create real-time reports and dashboards.
? Expertise in knowing the technical limitations of various Azure components. Ex: Storage Accounts (BLOB, General Purpose V1, General Purpose V2 & Data Lake Storage) and providing the solutions based on the limitations.
? Good Knowledge in Azure DW, ADB and good technical expertise in writing stored procedures & views.
? Installation of Data Management Gateway to connect to on premise DB and Integrated with Azure Data Factory.
? To extract on premise data or Azure BLOB incrementally and load data to Data Lake storage, Azure Data Warehouse.
? Technical expertise in different activity like Copy, Lookup, Stored Procedure, Custom & Meta Data Activity.
? Expertise in Error handling and creation of Audit Log mechanism for Pipelines.
? Expertise in scheduling the Pipelines like Schedule, Tumbling Window and Event Based.

General Expectations:

? Define, Prototype and build reusable, modular artefacts that would help the team in performing deployments faster.
? Understanding fundamental design principles behind scalable applications
? Work with customer success teams to consult, deploy and maintain pipelines on behalf of customers.
? Regularly debug and optimise data pipelines and tweak them.
? Be able to quickly root-cause data related issues and fix them in real time.
? Excellent documentation skills - Should be skilled in creating architecture and design documentation and knowledge of data engineering tools & technologies
? Ability to learn and unlearn and re-learn new technologies and frameworks depending on organization needs.
? Excellent interpersonal, communication, and organizational skills. Must be able to communicate fluently in English both verbally and in writing
? Should be deadline and closure oriented.
? High Energy Levels. Should be self-driven.
? Must be able to thrive in a fast-paced, rapidly evolving environment with varying priorities, based on a team building culture.

Apply to More than 1000+ new jobs in your city


Key skills
Excellent Opportunity with our client for Senior Data Engineer (IC Role) (Job Code : J43766) Exp : 10 - 13 Years Location: Bangalore Key Skills: Azure Data Factory Please pass on or Share this message to your friends who are looking for similar roles
Last Date

Alert : FreshersLIVE Employees will not call any candidates towards Job Offer or Job assistance. FreshersLIVE will never charge any candidates for Jobs. Please be aware of fraudulent calls or emails. Please write to [email protected] for any assistance.
Disclaimer: This Job is auto-published from MonsterIndia. For any issues with above Job Posting, please contact MonsterIndia

Apply Various Job Roles on

Job Role Apply Link
Other Roles Other Roles Jobs 2021 (56906 Vacancies)
Anganwadi Worker Anganwadi Worker Jobs 2021 (50485 Vacancies)
Software Software Jobs 2021 (28730 Vacancies)
Trainee Trainee Jobs 2021 (25783 Vacancies)
Programmer Programmer Jobs 2021 (23786 Vacancies)
Designer Designer Jobs 2021 (10474 Vacancies)
Sub Inspector Sub Inspector Jobs 2021 (10291 Vacancies)
Application Engineer Application Engineer Jobs 2021 (9959 Vacancies)
Constable Constable Jobs 2021 (9847 Vacancies)
Gramin Dak Sevak Gramin Dak Sevak Jobs 2021 (9213 Vacancies)
Pre Primary Teacher Pre Primary Teacher Jobs 2021 (8395 Vacancies)
Customer Service Executive Customer Service Executive Jobs 2021 (7736 Vacancies)
Trained Graduate Teacher Trained Graduate Teacher Jobs 2021 (6698 Vacancies)
Assistant Assistant Jobs 2021 (5024 Vacancies)
Auxiliary Nurse Midwifery Auxiliary Nurse Midwifery Jobs 2021 (5000 Vacancies)
Medical Officer Medical Officer Jobs 2021 (4802 Vacancies)
Development Officer Development Officer Jobs 2021 (4396 Vacancies)
Apprentice Apprentice Jobs 2021 (3607 Vacancies)
Business Development Manager Business Development Manager Jobs 2021 (3064 Vacancies)
Health Officer Health Officer Jobs 2021 (2850 Vacancies)
View More Jobs By Role (1 lakh + vacancies) has taken maximum steps to ensure that the job posting is genuine. This Job posting was made by the company/recruiter directly and exclusively on If the recruiter is charging any Fees from the job seekers, please write to us at [email protected] / [email protected].