Data Engineer Support at WTW Full Time

Responsibilities

• Configure deployment pipelines for code releases from technical teams
• Setup monitoring schedules for pipelines based on consumer usage areas
• Troubleshoot failed pipelines and suggest solutions for future issues
• Review Synapse notebooks for errors and provide details to development teams
• Review and fix Synapse notebooks errors through DevOps process
• Provide onboarding and configuration for new ingestion data sources
• Provide DevOps support for deployments to core data lake repositories
• Apply security access governance processes in line with practices
• Review and update access reports quarterly for appropriate actions
• Troubleshoot pipeline failures and report status on functionality
• Suggest improvements for pipelines and data extraction/ingestion
• Utilize visualization methods for data to achieve business outcomes

Requirements

• Advanced understanding of Azure Synapse, Azure Key Vault, Azure Data Lake Storage v2
• Experience with Python and creating/editing pySpark notebooks
• Experience in designing and evolving data solutions in Azure Cloud
• Experience with large data sets and data structures in Azure Cloud
• Experience with Azure SQL DB, Azure Synapse Analytics, or similar tools
• Experience with data presentation using reporting tools like Power BI
• Knowledge of data modeling and management techniques
• DevOps experience using GIT, developing, deploying code to production
• Ability to manage multiple tasks and resolve issues
• Ability to collaborate with multiple teams and work globally
• Ability to solve problems using critical thinking techniques

Benefits

• This is a remote position; work from home