Location: Remote
Job Schedule: Full Time
Salary: 128,502.00/Annum
Job duties:
- Developing and implementing data pipelines using Azure Synapse Pipelines.
- Identify the data sources and destinations for customer data integration or transformation tasks and configure parameters and variables to make pipeline more flexible and reusable.
- Creating, managing, and maintaining automation workflows using Azure Runbooks.
- designs, develop, and implement automated solutions to streamline and optimize various tasks and processes within the Azure cloud environment.
- SQL Query optimization and performance tuning
- Analyze complex queries and look for opportunities to rewrite them in a more optimized form. Simplify subqueries, eliminate unnecessary joins.
- Use parameterized queries to prevent SQL injection and improve query plan catching, which can lead to better performance.
- Migrating data from a virtual machine (VM) to SQL Managed Instance.
- Plan and execute the backup of the source database on the VM. Restore the database backup to the SQL Managed Instance.
- Participate in testing the application with the new SQL Managed Instance to verify data integrity and identify any data-related issues.
- Performing Data Analysis and Data Scientists tasks
- Analyze and profile the existing data to identify data quality issues and inconsistencies.
- Evaluate data usage patterns and identify areas for improvement in data processing.
- Propose data cleansing, transformation, and enrichment strategies.
- Automating existing manual tasks by writing Stored Procedures in SQL
- Collaborate with other teams and stakeholders to identify the need for automation and understand the scope of the project.
- Creating and maintaining Audits, stored procedures, and user defined functions as per client requirements and creating database triggers for automation.
- Designing Architecture for ETL/SSIS packages and Designing SSIS packages with different data sources (SQL, Flat files and XMLs etc.) and loading the data into target source by performing different kinds of transformations.