Azure DataLake Support
Posted on: January 25, 2023
Title: Azure DataLake Support
Location: Schaumburg, Illinois/Hybrid - Can be initially remote
--- Should have hand-on experience on Azure Data Factory, Azure
Data Lake, Azure Automation Account, Storage Accounts, HDInsights,
Azure Data bricks, Batch Accounts and Azure SQL
--- Hands On Experience in writing Spark and Scala Programs.
--- Experience in creating Azure Data factory pipelines using ARM
template and PowerShell.
--- Experience in optimizing and tuning Hive and Spark queries.
--- Experience in data analysis and also finding root cause for
--- To maintain the number of nodes in HDInsight, Batch Account and
Data bricks clusters according to the requirements and request
platform team to increase/decrease them accordingly.
--- To maintain DTU percentage of Azure SQL according to the
requirements and request platform team to increase/decrease them
--- To maintain codes and release branches in cloud (VSTS) and
ensure version is maintained according to the continuous
--- To implement CR/new change/new source through VSTS using CI/CD
--- To prepare and maintain deployment documents.
--- To create VSTS tasks for every code change and deployments.
--- To monitor the daily/weekly/monthly/yearly and on-demand
provisioning and curation/consumption loads running on Azure
--- Ensuring that the jobs are starting on time and finishing
before SLA hours.
--- Validate whether all the monthly jobs are completed as per the
--- To check and validate data integrity in Azure Data Lake with
respect to different on-premise sources.
--- Creating incidents(Service Now tickets) for the failures
--- Migrating the ETL related changes based on the requests for
--- Analyzing the incident tickets and sometimes the resolution
would require the code change or data fix.
--- Responsible for providing the resolution / fixing the issue
within the SLA time
Keywords: Apolis, Schaumburg , Azure DataLake Support, Other , Schaumburg, Illinois
Didn't find what you're looking for? Search again!