Data Engineer/Sr. Data Engineer -ITDDP (Contractual)
IMF Headquarters 2, United States
USD 119K-166K (estimate) Senior-level Contract Full Time
Tasks
- Build and maintain ELT workflows
- Build and maintain ETL ETL pipelines
- Build semantic models for reporting
- Create aggregations for performance
- Create infrastructure-as-code deployments
- Design self service analytics datasets
- Develop data modeling and visualization
- Enable governed BI usage
- Enforce Azure RBAC and policies
- Enforce data classification and access controls
- Ensure backup and disaster recovery
- Implement data lineage
- Implement data quality and schema evolution controls
- Implement data quality checks
- Implement partitioning and indexing
- Ingest batch and real time data
- Integrate managed service providers
- Integrate semantic layer with upstream pipelines
- Manage data governance with Collibra
- Manage data governance with Microsoft Purview
- Manage data lakes
- Manage data warehouses
- Monitor Azure platform health
- Optimize Delta storage
- Optimize Lakehouse performance
- Optimize compute and storage costs
- Optimize star schemas
- Orchestrate pipelines with Azure Data Factory
- Provision Azure cloud resources
- Secure Azure networking
- Set up CI/CD pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
API | Analysis Services | Azure | Azure Analysis | Azure Analysis Services | Azure Data | Azure Data Factory | Azure DevOps | Azure Functions | Azure Purview | Backup | CI/CD | Collibra | Data Classification | Data Factory | Data Governance | Data Lake | Data Lineage | Data Warehouse | Delta Lake | Disaster Recovery | ELT | ETL | Event Driven | Event-driven architecture | GitHub Actions | Infrastructure as Code | Lakehouse | Microsoft Fabric | Monitoring | Oracle PL | Oracle PL/SQL | PL/SQL | Power BI | RBAC | Real Time | Real-time analytics | Semantic Model | Star Schema | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior-level Full TimeAuburn Hills, MI, United States14h ago
-
Data Scientist (Graph analysis) USD 135K-185KCypher | Data Ingestion | Data Processing | Docker | ETLOn-site workMid-level Full TimeColumbia, MD, United States14h ago
-
AI Engineer, Forward Deployed USD 180K-240KAPI Development | AWS | Agentic Workflows | Code Reviews | ContainersHybrid work flexibility | Relocation support (if needed) | Training support | Travel opportunitiesSenior-level Full TimePhiladelphia, PA, United States16h ago
-
SOFTWARE ENGINEER - Algorithm Development - 20+ yrs of Experience - TS/SCI w/Poly clearance is required - RC A USD 232K-239KAlgorithm Development | COTS | Data Query | Data Repository | Database interface401k retirement plan | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimeAnnapolis Junction, United States16h ago
-
Data Management Engineer III USD 93K-163KCI/CD | Data Deduplication | Data Pipelines | Data Standardization | Data TransformationPublic Trust Clearance | Travel 10 to 15 percentSenior-level Full TimeArlington/Rosslyn, Virginia, United States17h ago
-
Partner Engineer, Generative AI USD 159K-223KAWS | Azure | Bias Mitigation | C plus plus | Cloud PlatformsEntry-level Full TimeMenlo Park, CA18h ago
-
Staff Software Engineer, AI-Powered GRC Automation USD 207K-300KCloud Platforms | Cloud platform | Continuous controls monitoring | Controls monitoring | Data PipelinesSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA19h ago
-
Senior Staff Software Engineer, BigQuery Core Analytics USD 262K-365KBigQuery | C plus plus | C++ | CI/CD | Distributed SystemsSenior-level Full TimeKirkland, WA, USA; Sunnyvale, CA, USA19h ago
-
Continuous Delivery | Continuous integration | Databases | DevOps | DockerFlexible scheduling for students | Fully remote work | Online teaching toolsMid-level Full TimeChur, Institut für Data Analysis, Artificial … R19h ago
-
Staff Machine Learning Engineer, Embeddings USD 253K-354KA/B | A/B Testing | B testing | C++ | Cloud ComputingCaregiving support | Comprehensive healthcare benefits | Employer 401k match | Family planning support | Flexible vacationSenior-level Full TimeRemote - United States R1d ago
-
Lead ML Inference Engineer, Advertising USD 246K-486KCo-design | Distributed Systems | GPU Acceleration | Hardware-Software Co-design | Hardware/softwareDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California1d ago
-
Software Engineer - Developer Products (AI) USD 170K-240KAPI Design | APIs | CLIs | Data Structures | Data Structures and AlgorithmsEmployee benefits package | Remote-friendly work environmentSenior-level Full TimeSan Francisco, California1d ago
-
Forward Deployed Engineer USD 70K-100KAPIs | Agent systems | Automation | BPM | Cloud ComputingEquity | Health benefits | Remote workSenior-level Full TimeBoston, Massachusetts; New York, New York; …1d ago
-
Forward Deployed Engineer USD 70K-100KAPI Integration | Agent systems | Agentic AI | BPM | Cloud ComputingEquity | Flexible work environment | Health benefits | Remote work optionsSenior-level Full TimeBoston, Massachusetts; New York, New York; …1d ago
-
AI Software Engineer (Vehicle Engineering) USD 125K-175K3D Reconstruction | Agent systems | Agentic AI | Anomaly Detection | CI/CD401k retirement plan | Dental insurance | Employee stock purchase plan | Life insurance | Life insurance coverageSenior-level Full TimeHawthorne, CA1d ago
-
Lead AI Engineer (ML Ops) USD 116K-170KAPIs | AWS | Agile Scrum | Azure | CI/CD401k match | Employee assistance program | Employee charity match | Employee stock purchase plan | Health and wellness allowanceSenior-level Full TimeIrving - 6011 Connection, United States1d ago
-
Platform and Databricks DevOps Engineer USD 77K-176KAWS | Azure | Bash | CI/CD | DatabricksDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsMid-level Full TimeUSA, VA, McLean (8283 Greensboro Dr, …1d ago
-
Data AI Solutions Sr Analyst - C12 - TAMPA USD 87K-130KAgentic AI | Artificial Intelligence | Data Catalog | Data Governance | Data LineageSenior-level Full Time3800 CITIGROUP CENTER DRIVE BUILDING F …1d ago
-
Senior Bioinformatics Data Engineer (Consultant) USD 168K-200KADaM | AWS ECS | AWS ECS Fargate | AWS Glue | AWS Glue CatalogBackground check | Code review feedback loops | Compliance training | Embedded pair working model | VPN AccessSenior-level Full TimeRaleigh, United States1d ago
-
AI assisted code | AI-assisted code generation | Amazon Redshift | Anomaly Detection | BigQueryAI focused engineering culture | Mentorship and growth opportunities | On-site collaborationSenior-level Full TimeBoston, MA1d ago
-
AWS | AWS Redshift | Attribution | Audience Segmentation | BigQueryCompetitive compensation | Growth opportunities | Hands on production experience | Mentorship | On-site collaborationEntry-level Full TimeBoston, MA1d ago
-
AWS | AWS Redshift | Amazon Kinesis | Anomaly Detection | Automated testingSenior-level Full TimeBoston, MA1d ago
-
Software Engineer AI/ML USD 112K-150KA/B | A/B Testing | AWS | Anomaly Detection | Artificial IntelligenceDental insurance | Employee assistance program | Health coaching program | Health insurance | Retirement benefitsMid-level Full TimeEvendale, United States R1d ago
-
Senior AI Engineer USD 130K-198KAPI Design | Azure | CI/CD | Data Pipelines | DatabricksFertility benefits | Flexible PTO | Mental health coverage | Paid parental leave | Paid volunteer time offSenior-level Full TimeArlington, VA, United States1d ago
-
Sr. AI Engineer - Forward Deployed Engineer Senior Manager· Databricks · Reinvention Centers USD 87K-293KAPI Integration | Anthropic API | Apache Spark | Autogen | CI/CD401k plan | Bonus opportunities | Dental insurance | Life insurance | Long-Term Disability coverageSenior-level Full TimeDallas, 5205 N OConnor Las Colinas, …1d ago