Principal ETL Developer
1662 Intelligence Community Campus - Bethesda MD, United States
USD 131K-237K Senior-level Full Time
Tasks
- Architect NiFi data pipeline designs
- Balance load for batch and real time processing
- Build Elasticsearch integrations
- Build Kafka integrations
- Conduct code reviews
- Create NiFi documentation
- Create technical architectures documentation
- Define NiFi deployment best practices
- Define NiFi development standards
- Develop enterprise ETL architectures
- Diagnose data discrepancies
- Ensure NiFi security and governance
- Fix integration failures
- Implement NiFi data pipelines
- Integrate NiFi with cloud platforms
- Integrate NiFi with databases and big data
- Maintain data flow mappings
- Manage S3 data integrations
- Manage memory for NiFi data flows
- Optimize NiFi performance
- Provide technical mentorship
- Resolve performance bottlenecks
- Troubleshoot NiFi data flow issues
- Tune NiFi processors
Perks/Benefits
- 401k company match
- Discounted stock purchase plans
- Education and training support
- Flexible schedules
- Immediate vesting
- Paid Holidays
- Paid time off
- Parental paid leave
- Technical upskilling
Skills/Tech-stack
AWS | Amazon S3 | Amazon SNS | Amazon SQS | Apache NiFi | Azure | Cloud infrastructure | Data Lake | DynamoDB | ETL | Elasticsearch | Java | Kafka | Load Balancing | Memory Management | NiFi Clustering | NiFi Registry | NoSQL | Oracle Cloud | Oracle Cloud Infrastructure | PostgreSQL | Python | REST | Real Time | Real-time Streaming | SQL
Education
Roles
Developer | ETL Developer | Principal | Principal ETL Developer
Related jobs
-
API performance | Agent systems | AlloyDB AI | BigQuery | C++Senior-level Full TimeAtlanta, GA, USA; Austin, TX, USA5h ago
-
AI Developer USD 130K-177KAzure DevOps | Azure Functions | C# | CI/CD | Containers401k with company match | Dental insurance | Immediate vesting | Medical insurance | Vision insuranceSenior-level Full TimeAustin TX17h ago
-
Senior Software Engineer, Backend (Applied AI) USD 190K-230KAPI Design | AWS | Agentic Workflows | Asynchronous Workflows | Cloud Computing401k match | Health insurance | Holidays | Paid parental leave | Remote-firstSenior-level Full TimeRemote (United States) R18h ago
-
Acquisition Funnel | Acquisition Funnel Analysis | Budgeting | Campaign Measurement | Data VisualizationSenior-level Full TimeUnited States R19h ago
-
Principal AI Engineer II USD 148K-258KAPIs | AWS | Artificial Intelligence | CI/CD | Change Control401k | Dental insurance | Medical insurance | Paid time off | Vision insuranceSenior-level Full TimeNorth Chicago, IL, United States20h ago
-
Principal, Data/Analytics and Benchmarking USD 129K-186KAI | Benchmarking | Dashboarding | Data Governance | Data ModelingSenior-level Full TimeUnited States R22h ago
-
AI Agents | Active Directory | Azure | Claude | Entra IDRemote workMid-level Full TimeUnited States R1d ago
-
Principal Data Scientist USD 96K-160KAnomaly Detection | Apache Spark | Bayesian Inference | Causal Inference | Classification401k company match | Dental insurance | Disability insurance | Medical insurance | Mileage reimbursementSenior-level Full TimeFrisco, Texas, United States R1d ago
-
AI Systems & ML Engineering Industry Expert USD 140K-209KA/B | A/B Testing | API Design | AWS | Agentic SystemsFlexible schedule | Fully remote | Hourly payment | International teamSenior-level Part TimeNew York City, NY, US R1d ago
-
Cognos Analytics | DB2 | Data Mart | Data Modeling | Data QualityMid-level Full TimeAlbany, NY, United States R1d ago
-
Principal Engineer - Supply Chain AI Solutions USD 125K-183KAWS | Agentic Workflows | Airflow | Authentication | AuthorizationSenior-level Full TimeNovi - Michigan, USA - Cabot …1d ago
-
Principal Engineer - HR AI Solutions USD 125K-183KAWS | AWS Bedrock | Anthropic | Azure | Azure OpenAIBackground investigation and drug screen required | Employee discounts | Hybrid work | Training opportunitiesSenior-level Full TimeNovi - Michigan, USA - Cabot …1d ago
-
Principal Engineer - Finance AI Solutions USD 125K-183KAWS | Access Control | Airflow | Auditability | AzureEmployee discounts | Training opportunities | Wellness benefitsSenior-level Full TimeNovi - Michigan, USA - Cabot …1d ago
-
Staff AI Solutions Deployment Developer, Applied AI USD 183K-265KAPI Development | Agentic AI | Architectural Guidance | Cloud Architecture | Cloud platformSenior-level Full TimeWaterloo, ON, Canada; New York, NY, …1d ago
-
Senior-level Full TimeCINCINNATI, OH, United States1d ago
-
Analytics Developer USD 75K-110KBusiness Intelligence | Data Analysis | Power BI | Python | SQLOn-site collaboration | Professional developmentMid-level Full TimeWestlake, TX, United States1d ago
-
AI Integration Sr. Analyst – Risk Analytics USD 209K-262KAI Testing | API Integration | Agent Orchestration | Agent systems | Data Governance401k match | Disability insurance | Fertility and family building aids | Health insurance | Life insuranceSenior-level Full TimeTexas Capital Center, United States1d ago
-
Principal Engineer - AI Engineering USD 159K-254KAgent systems | Agentic AI | Ansible | Azure Machine Learning | ChainlitOn-site work | Relocation assistance not available | Visa sponsorship not availableSenior-level Full Time109562-CA-1755 Grant, Concord, United States1d ago
-
Principal AI Engineer USD 110K-174KAI Evaluation | AI Governance | AI Observability | AI SecOps | APISenior-level Full TimeAtlanta HQ North Tower Office, United …1d ago
-
Prinicipal, Data Engineer USD 117K-150KAccess Controls | Apache Spark | Automated testing | Azure | Azure DatabricksAccessibility | Cafeteria | Child care | Coaching | Domestic/international travelSenior-level Full TimeAtlanta, US1d ago
-
Principal Analyst - Commercial Analytics and Insights USD 111K-166KAI-assisted analytics | CRM | DBT | Dashboard Development | Data Automation401k match | Dental insurance | Health insurance | Health savings account | Life insuranceSenior-level Full TimeUSA-MA Mansfield, United States1d ago
-
Principal Software Engineer, Splunk Analytics and Search USD 241K-322KAWS | Amazon Athena | C++ | Cloud Native | Data Processing401k matching | Basic life insurance | Flexible vacation time | Long-term disability | Medical, dental, and vision insuranceSenior-level Full TimeSeattle, Washington, United States of America1d ago
-
Senior-level Full Time300 New Millennium Way, Durham NC, …1d ago
-
Principal Data Scientist USD 96K-160KAnomaly Detection | Apache Spark | Bayesian Inference | Causal Inference | Classification401k company match | Dental insurance | Disability insurance | Medical insurance | Mileage reimbursementSenior-level Full TimeFrisco, TX1d ago
-
Principal Software Engineer - Embedded OS USD 152K-229KAgile | Artifactory | BSP | Bamboo | Bash401k match | Dental insurance | Health insurance | Health savings account | Paid HolidaysSenior-level Full TimeUSA-CO Lafayette Bldg 2, United States1d ago