Principal Data Engineer, Operations Manager II (NCS) - Mayor's Office of Performance and Innovation
Tasks
- Automate data ingestion from APIs and files and databases
- Build data lakehouse tiered layers
- Contribute to data governance and tooling
- Design data warehouse
- Develop and maintain ETL/ELT pipelines
- Develop orchestration frameworks
- Implement data quality monitoring and alerting and logging
- Maintain centralized data models for reporting and analysis
- Manage project team and timelines
- Translate business questions into data products
Perks/Benefits
- Accidental death and dismemberment insurance
- Dental insurance
- Employee assistance program
- Flexible spending account
- Medical insurance
- Optional life insurance
- Prescription Drug Coverage
- Support groups
- Vision insurance
- Wellness programs
- Workshops
Skills/Tech-stack
APIs | Alerting | CI/CD | Data Lakehouse | Data Modeling | Database Design | ELT | ETL | Geospatial | GitHub | Logging | Monitoring | Pandas | Polars | PostgreSQL | Python | SQL | SQLAlchemy
Education
Roles
Architect | Data Architect | Data Engineer | Engineer | Manager | Project Manager
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R21d ago
-
Agentic AI Architect USD 122K-283KAWS Neptune | Agent Orchestration | Agent evaluation | Agent systems | Autonomous decision-makingSenior-level Full TimeDallas, TX, US5h ago
-
Data Engineer - Emergency Preparedness and Response USD 117K-151KAzure | Azure Data | Azure Data Factory | Azure Databricks | Big DataEmergency response availability | Health safety wellbeing focus | Hybrid work scheduleMid-level Full TimeDetroit, MI, US5h ago
-
Software Engineer, Embedded Agentic AI USD 170K-210KAgent Orchestration | Agent systems | C# | C++ | Cloud PlatformsDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offEntry-level Full TimeSan Jose, California8h ago
-
Staff Engineer, GenAI Tooling & DevEx (R5469) USD 121K-197K*nix | AWS | Access Management | Active Directory | Azure GovSenior-level Full TimeWashington, DC9h ago
-
Operations Analytics Manager USD 140K-170KBusiness Analytics | Capacity Planning | Data Engineering | Data Governance | Data Modeling401k retirement savings | Equity in high growth startup | Healthcare FSA/HSA subsidy | Medical, dental, and vision coverage | Paid HolidaysMid-level Full TimeRemote, United States R10h ago
-
Staff Machine Learning Engineer, Personalization USD 152K-277KAirflow | Apache Spark | BigQuery | Contrastive Learning | Deep learning401k match | Disability insurance | Electric Car Charging Station | Employee assistance program | Flexible spending accountSenior-level Full TimeMountain View, USA11h ago
-
Senior Applied AI Engineer USD 205K-238KAgentic Methodologies | Agentic Workflows | Deep learning | Fine Tuning | Generative AIFamily planning support | Flexible time off | Lifestyle stipend | Mental health support | Paid parental leaveSenior-level Full TimeSan Francisco, CA R11h ago
-
Data Engineering Manager USD 139K-208KCloud Native | Cloud Native Architecture | Data Lakes | Data Modeling | Data Warehouses401k | Medical/Dental/Vision | PTO | Tuition assistanceMid-level Full TimeNew York, NY, US, 1003612h ago
-
2027 Technology, Data, AI & Ventures Summer Internship Program - AI Engineer (MLOps) Intern USD 60K-70KAPIs | Automated testing | CI/CD | DevOps | Generative AICapstone project | Hybrid work | Networking opportunitiesEntry-level InternshipNew York, NY, US12h ago
-
AWS Glue | Amazon Redshift | Amazon Web Services | Cloud platform | DBTAdoption Assistance | Hybrid schedule | Leave programs | Student loan repayment programEntry-level InternshipNew York, NY, US12h ago
-
Application Software Engineer, Applied AI USD 125K-200K.NET | A/B | A/B Testing | AI Observability | Agent Orchestration401k plan | Company shuttles | Employee stock purchase plan | Life insurance | Long-term disability insuranceSenior-level Full TimeRedmond, WA12h ago
-
Application Software Engineer, Applied AI USD 160K-225K.NET | A/B | A/B Testing | AI Observability | Agent OrchestrationBackground check required | Extended hours weekends as needed | Onsite work requiredSenior-level Full TimeCape Canaveral, FL12h ago
-
Application Software Engineer, Applied AI USD 125K-160K.NET | A/B | A/B Testing | Agent Orchestration | Agentic Systems401k retirement plan | Life insurance | Long-term disability insurance | Medical/Dental/Vision insurance | Paid HolidaysSenior-level Full TimeVandenberg, CA12h ago
-
Application Software Engineer, Applied AI USD 160K-225KA/B | A/B Testing | Agent Orchestration | Agentic Systems | AngularOnsite workSenior-level Full TimeStarbase, TX12h ago
-
Application Software Engineer, Applied AI USD 160K-225KA/B | A/B Testing | AI Observability | Agent Orchestration | Agentic SystemsCollaborative team environment | Extended hours weekends as needed | Onsite workSenior-level Full TimeMcGregor, TX12h ago
-
Application Software Engineer, Applied AI USD 160K-225K.NET | A/B | A/B Testing | Agent Orchestration | Agentic SystemsOnsite workSenior-level Full TimeBastrop, TX12h ago
-
Application Software Engineer, Applied AI USD 125K-160K.NET | A/B | A/B Testing | Agent Orchestration | Agentic Systems401k plan | Disability insurance | Life insurance | Medical, dental, and vision coverage | Paid HolidaysSenior-level Full TimeHawthorne, CA12h ago
-
Advanced Excel | Business Intelligence | Data Governance | Data Management | Data analytics401k employer match | Commuter benefits | Employee stock purchase program | Employer paid medical/dental/vision | FSAMid-level Full TimeRemote - USA R12h ago
-
Senior Data Engineer, Ads USD 220K-245KAnomaly Detection | Automated Anomaly Detection | BigQuery | DBT | DagsterSenior-level Full TimeSan Francisco Bay Area13h ago
-
Data Engineer USD 180K-200KBigQuery | CI/CD | DBT | Data Modeling | Data QualityBenefits | Equity | Inclusion and accommodationsMid-level Full TimeSan Francisco Bay Area13h ago
-
Senior AI/LLM Engineer USD 179K-201KAPI Development | CI/CD | Embeddings | Fine Tuning | Guardrails401k match | Dental insurance | Health insurance | Remote work | Vision insuranceSenior-level Full TimeRemote (US/Canada) R13h ago
-
Senior-level Full TimeNew York13h ago
-
Senior-level Full TimeWoodinville, Washington, United States13h ago
-
Manager, Data Analytics USD 110K-125KA/B | A/B Testing | Adobe Analytics | Amazon Athena | Amazon QuickSightMid-level Full TimeEl Segundo, CALIFORNIA, United States13h ago