Job Description

Azure Data Factory (ADF) Engineer (Active Secret or Above Required)

Azure Data Factory (ADF) Engineer (Active Secret or Above Required)

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from Intellect Solutions LLC

US Federal IT Recruiter | Cleared Facility Recruitment (Secret, TS/SCI, CI Poly, FSP) | Connecting Top Talent with Government Contracts

Please apply only if you hold an Active Secret (or higher) clearance

Requirements Gathering

• Collaborate with business analysts, data architects, and stakeholders to gather requirements and ensure data integrity throughout the migration lifecycle.
• Ability to create Data mapping documents (Source to Target) by understanding business rules.
• Perform data profiling, cleansing, and quality checks to ensure accuracy and completeness of migrated data.
• Analyze and map source Oracle database schemas to target Dataverse tables/entities, defining transformation and cleansing logic as required.

Technical Requirements for Development

• Write and optimize SQL queries, stored procedures, and scripts for Oracle databases to support data migration and validation.
• Implement data transformation processes to ensure data compatibility with Dataverse data types, relationships, and constraints.
• Experience with Dataverse data types and CRUD operations
• Experience configuring data pipelines inADF(to extract, transform, load).
• Experience using .csv files as sources of data for theADFpipelines
• Experience using Oracle CDCs as sources of data for theADFpipelines.
• Experience logging errors (audit framework) from anADFpipeline to a Dataverse table
• Experience pushing data to Dataversetable(s) including necessary transformations to match target field types (i.e. Dataverse lookups, choices, date/time, etc.)
• Experience configuring setting for pipelines to improve concurrency/performance (i.e.,ADFcores, memory, etc.)
• Experience with additional Azure services (e.g., Logic Apps, Data Lake, Azure Functions, Azure SQL).
• Experience/exposurein python/shell scripting is a plus
• Ability to generate a reconcile report of the migrated data using SQL or scripts

Code Migration

• Must be familiar with Git or source code repository & CI/CD process.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Contract

Job function

• Job function

  Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Intellect Solutions LLC by 2x

Get notified about new Data Specialist jobs in Washington, DC .

Washington, DC $50,000.00-$100,000.00 4 days ago

Data Management Analyst, Junior (Future Need)

Arlington, VA $30,000.00-$40,000.00 3 months ago

District of Columbia, United States 1 month ago

Washington DC-Baltimore Area $50.00-$80.00 2 weeks ago

Washington DC-Baltimore Area $95,000.00-$110,000.00 2 weeks ago

Washington DC-Baltimore Area $65,000.00-$80,000.00 4 weeks ago

Washington, DC $148,221.00-$160,000.00 1 week ago

District of Columbia, United States $106,250.00-$143,750.00 19 hours ago

Oncology Data Specialist - Full Time, Days, 100% Remote

District of Columbia, United States $68,000.00-$113,000.00 1 week ago

Washington, DC $110,000.00-$150,000.00 2 months ago

Maryland, United States $95,000.00-$100,000.00 1 week ago

Fairfax, VA $89,203.00-$151,646.00 14 hours ago

Reston, VA $60,927.00-$103,576.00 4 days ago

Temporary - Admissions Systems & Data Analyst

Washington, DC $120,000.00-$190,000.00 1 month ago

McLean, VA $80,000.00-$100,000.00 3 weeks ago

Maryland, United States $70,000.00-$110,000.00 2 months ago

Washington, DC $83,000.00-$112,000.00 4 months ago

Maryland, United States $68,000.00-$110,400.00 2 weeks ago

Data Governance Lead - Databricks / Alation

Staff Engineer - Finance Data Specialist (Remote)

Washington, DC $115,000.00-$260,000.00 1 week ago

Staff Engineer - Finance Data Specialist (Remote)

Washington, DC $115,000.00-$260,000.00 3 weeks ago

Were unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

Job Tags

Similar Jobs