Senior Technical Data Engineer - Boston, MA
Tasks
- Build CI/CD pipelines
- Build Lakehouse solutions with Medallion architecture
- Build data pipelines
- Create data models and documentation
- Design data integration solutions
- Develop SSRS and Power BI reports
- Ensure data security, privacy, and compliance
- Evaluate and implement data quality and observability tools
- Implement configuration driven ingestion
- Implement data governance cataloging and MDM
- Implement monitoring and observability for data pipelines
- Improve data engineering processes for automation and reliability
- Ingest and transform data from APIs JSON CSV and XLS
- Manage Azure data platform health scalability and security
- Manage access controls data lineage and metadata
- Mentor junior engineers and support onboarding
- Optimize pipeline performance scalability and cost
- Plan sprints and backlog refinement with Agile ceremonies
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | Azure Data | Azure Data Factory | CI/CD | CSV | CircleCI | Data Cataloging | Data Dictionary | Data Factory | Data Flow | Data Flow Diagrams | Data Governance | Data Lineage | Data Management | Data Modeling | Data Quality | DataOps | Databricks | Dimensional Modeling | ERD | Flow diagrams | GitHub | GitHub Actions | JSON | Lakehouse | MDM | Master Data | Master Data Management | Medallion Architecture | Metadata Management | Monitoring | NoSQL | Observability | Power BI | SQL Server | SSRS | T-SQL | XLS | XML
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R9d ago
-
Batch Processing | CI/CD | Cloud Computing | Data Architecture | Data ModelingMid-level Full TimeChicago, IL, United States1h ago
-
Senior AI Software Engineer USD 85K-125KAWS | Amazon Bedrock | Amazon EKS | Amazon ElastiCache | Amazon S3Employee assistance program | Employee stock purchase plan | Hybrid work | Paid parental leave | Paid time offSenior-level Full TimeHilton - Systems Solutions - McLean …4h ago
-
Software Engineer, Systems USD 221K-240KAlgorithms | CSS | Data Analysis | Data Modeling | Data ProcessingEntry-level Full TimeBellevue, WA5h ago
-
Senior Robotics Software Engineer - Simulation USD 130K-170KBullet | C++ | CI/CD | Data Generation | Digital TwinsSenior-level Full TimeSan Jose, CA13h ago
-
Senior-level Full TimeSan Jose, CA14h ago
-
Senior Software Engineer - Data Platform USD 186K-218KAccess Control | Airflow | Apache Kafka | Apache Spark | CachingSenior-level Full TimeRemote - USA R14h ago
-
Senior-level Full TimeHybrid (Salt Lake City, UT, US) R16h ago
-
Lead- Full Stack Engineer USD 150K-190KAWS Fargate | AWS Lambda | Amazon RDS | Amazon S3 | CI/CDCareer development opportunities | Entrepreneurial environment | Equal employment opportunity | High responsibilityMid-level Full TimeMcLean, Virginia, United States17h ago
-
API Integration | AWS | Adobe Commerce | Azure | BI Dashboards401k retirement plan | Health insurance | Hybrid work schedule | Paid time off | Performance bonusSenior-level Full TimeWeymouth, Massachusetts, United States17h ago
-
Robotics Perception Engineer USD 140K-204KC++ | CI/CD | Camera-based perception | Cameras | Cloud processingCompany-provided laptop | Dental insurance | Health insurance | Paid time off | Remote work optionMid-level Full TimeAtlanta, Georgia, United States - Remote R17h ago
-
Robotics Hardware Integration Engineer USD 120K-158KAWS IoT | AWS IoT Core | AWS IoT Greengrass | C++ | CANDirect impact on shipped products | Early-stage company | Equity | Health, dental, and vision insurance | Permissive time off policyMid-level Full TimeAtlanta, Georgia, United States - Remote R17h ago
-
Robotics Navigation and Control Engineer USD 160K-240KA Star | C++ | CI/CD | EKF | GazeboCompany laptop | Health, dental, vision benefits | Permissive time off | Remote work | Travel to Atlanta facility for hardware integrationSenior-level Full TimeAtlanta, Georgia, United States - Remote R17h ago
-
Lead AI Engineer (ML Ops) USD 116K-170KAPI Development | AWS | Azure | CI/CD | Cloud services401k match | Charity match | Employee assistance program | Employee stock purchase plan | Health and wellness allowanceSenior-level Full TimeIrving - 6011 Connection, United States17h ago
-
Senior-level Full TimeMcLean, VA, United States17h ago
-
Lead Data Engineer USD 179K-225KAWS | Agile | Amazon Redshift | Azure | CassandraHealth benefits | Inclusive work environment | Long-term incentives | Performance bonusSenior-level Full TimeMcLean, VA, United States17h ago
-
AI Search | AWS | Amazon SageMaker | Azure AI | Azure AI Search401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States17h ago
-
Senior-level Full TimeRedmond, WA, US18h ago
-
AI Engineer USD 150K-215KAgent Orchestration | Agent systems | AgentOps | Amazon Bedrock | Azure OpenAIMid-level Full TimeRemote United States R19h ago
-
Production Engineer USD 150K-350KAI Coding Agents | AI coding | Agentic Frameworks | Anthropic API | Coding AgentsDental insurance | Health insurance | Paid time off | Retirement plan | Vision insuranceMid-level Full TimeSan Francisco, CA19h ago
-
DevOps Engineer, Infrastructure & Security USD 236K-295KAWS | Azure | Azure DevOps | Bash | CI/CDCommuter stipend | Comprehensive health, dental and vision coverage | Generous PTO | Learning and development stipend | Retirement benefitsMid-level Full TimeSan Francisco, CA; New York, NY19h ago
-
AI, Data & Technology - AI-ML Engineer USD 112K-179KAWS | Apache Spark | Azure | BigQuery | CI/CDHybrid work model | In person work two days per week | Travel up to 40 percentSenior-level Full TimeChicago, IL, United States19h ago
-
Staff Software Engineer, Storage Platform USD 180K-270KAWS DynamoDB | AWS RDS | Aurora PostgreSQL | Caching | Connection pooling401k matching | Life and disability insurance | Lifestyle Wallet | Mental health benefits | Paid health insuranceSenior-level Full TimeBellevue, WA19h ago
-
Staff Analytics Engineer - Foundational Data USD 194K-240KAirflow | Apache Spark | Business Intelligence | Data Modeling | Data ProcessingEmployee travel credits | Remote eligibleSenior-level Full TimeUnited States20h ago
-
Senior Data Engineer USD 146K-180KAWS | AWS CDK | Amazon Redshift | Apache Airflow | CircleCI401k matching | Disability insurance | Flexible PTO | Free therapy access for employees and one household member | Friends and family discountSenior-level Full TimeNew York, NY (Hybrid) R20h ago