Principal ETL Developer
1662 Intelligence Community Campus - Bethesda MD, United States
USD 131K-237K Senior-level Full Time
Tasks
- Architect NiFi data pipeline designs
- Balance load for batch and real time processing
- Build Elasticsearch integrations
- Build Kafka integrations
- Conduct code reviews
- Create NiFi documentation
- Create technical architectures documentation
- Define NiFi deployment best practices
- Define NiFi development standards
- Develop enterprise ETL architectures
- Diagnose data discrepancies
- Ensure NiFi security and governance
- Fix integration failures
- Implement NiFi data pipelines
- Integrate NiFi with cloud platforms
- Integrate NiFi with databases and big data
- Maintain data flow mappings
- Manage S3 data integrations
- Manage memory for NiFi data flows
- Optimize NiFi performance
- Provide technical mentorship
- Resolve performance bottlenecks
- Troubleshoot NiFi data flow issues
- Tune NiFi processors
Perks/Benefits
- 401k company match
- Discounted stock purchase plans
- Education and training support
- Flexible schedules
- Immediate vesting
- Paid Holidays
- Paid time off
- Parental paid leave
- Technical upskilling
Skills/Tech-stack
AWS | Amazon S3 | Amazon SNS | Amazon SQS | Apache NiFi | Azure | Cloud infrastructure | Data Lake | DynamoDB | ETL | Elasticsearch | Java | Kafka | Load Balancing | Memory Management | NiFi Clustering | NiFi Registry | NoSQL | Oracle Cloud | Oracle Cloud Infrastructure | PostgreSQL | Python | REST | Real Time | Real-time Streaming | SQL
Education
Roles
Developer | ETL Developer | Principal | Principal ETL Developer
Related jobs
-
Business Objects | Dashboard Development | ETL | IBM DataStage | OracleMid-level Full TimeReston, VA; Springfield, VA3h ago
-
Agile | Cloud Storage | Google Cloud | Google Cloud Storage | GraphQLMid-level Full TimeSan Francisco, California; Remote, Canada, US, … R4h ago
-
Cloud Security | Cloud infrastructure | IT Operations | Linux | Network Automation401k | Career development | Employee referral bonuses | Flexible work-life balance | Health, dental, and vision insuranceSenior-level Full TimeLaurel, MD; Annapolis Junction, MD; Annapolis …4h ago
-
Senior-level Full TimeLinthicum, MD; Annapolis Junction, MD; Annapolis …6h ago
-
Data Modeling | Data Quality | Data Transformation | Data Visualization | Data extractionSenior-level Full TimeAustin, Texas6h ago
-
Apache NiFi | Elasticsearch | Java | MapReduce | MongoDBSenior-level Full TimeFt. Meade, MD7h ago
-
C plus plus | C# | Low-level programming | Python401k match | Federal Holidays | Fully-paid health benefits | Generous PTO | Tuition reimbursementMid-level Full TimeAnnapolis Junction, MD7h ago
-
Data Visualization | DevOps | JQuery | JSON | JavaScriptFull Scope Polygraph | TS/SCI clearanceMid-level Full TimeLaurel, MD7h ago
-
C# | C++ | Embedded Systems | Low-level programming | Python100 percent company paid medical | 401k contribution | Benefit flexibility | Paid time off | Professional development stipendMid-level Full TimeFt. Meade, MD7h ago
-
Senior Robotics Software Engineer (Full Stack) USD 100K-150KAlgorithm Design | C++ | IMU | Lidar | LinuxOnsite collaborationSenior-level ContractWilmington, MA; Wilmington, MA; Wilmington, MA8h ago
-
Principal Data Engineer – AWS Cloud | Irvine, CA | 100% Onsite | Long Term Contract - AS A USD 147K-177KAWS CloudFormation | Amazon Web Services | Apache Hadoop | Apache Spark | Cloud Architecture100 percent onsite | In person interview required | Long-term contractSenior-level ContractIrvine, CA9h ago
-
Data Scientist USD 140K-150KAI Builder | API Integration | Azure OpenAI | Canvas Power Apps | Cognitive Services401k matching | Dental insurance | Direct Deposit | Health insurance | Leave packageSenior-level Full TimeLexington Park, MD; Naval Research Laboratory, …9h ago
-
AWS | Amazon Web Services | CCNA | CentOS | CiscoSenior-level Full TimeColumbia, MD; Columbia, MD; Columbia, MD; …9h ago
-
Senior-level Full TimeAnnapolis Junction, MD; Annapolis Junction, MD; …9h ago
-
Senior Analytic Developer USD 126K-189KAPIs | Agile | Generative AI | Java | JupyterCode Red Days | Life insurance | Long-term disability | Medical/Dental/Vision | Paid HolidaysSenior-level Full TimeFort Meade, Maryland; Fort Meade, Maryland; …9h ago
-
AWS SNS | AWS SQS | Agile | Boto3 | ETLRemote workMid-level Full TimeChicago, IL9h ago
-
AI Pipelines | AI Studio | Access Management | BigQuery | BigQuery MLMid-level Full TimeChicago, IL9h ago
-
AWS | Apache Kafka | Apache Spark | Cloud platform | Distributed SystemsSenior-level Full TimeCambridge, MA; Boston, MA; Cambridge, MA; …9h ago
-
Ansible | Apache Spark | Clojure | Distributed Systems | DockerMid-level Full TimeBoston, Massachusetts; Woburn (moving to Boston …9h ago
-
Ansible | Apache Spark | Clojure | Data Analysis | Distributed SystemsSenior-level Full TimeBoston, Massachusetts; Boston, MA; Cambridge, MA; …9h ago
-
AMQP | AWS | Akamai | Apache | Bash401k | Flexible spending account | HMO | Healthcare | PPOSenior-level Full TimeBoston, Massachusetts; Boston, MA; Boston, MA; …9h ago
-
Senior-level Full TimeBoston, MA; Boston, Massachusetts; Boston, Massachusetts; …9h ago
-
AMQP | AWS EC2 | Akamai | Amazon RDS | Amazon S3401k | Flexible spending account | Health insurance | Paid time off | Stock optionsSenior-level Full TimeBoston, MA; Boston, MA; Boston, MA; …9h ago
-
AWS | Agile methodologies | Algorithms | Artificial Intelligence | Behavior-Driven DevelopmentAutonomy | Dental insurance | Efficient Tools | Gourmet coffee | Gym reimbursementSenior-level Full TimeCambridge, MA; Cambridge, MA; Cambridge, MA; …9h ago
-
API Design | Apache Hadoop | Apache Spark | C++ | Cloud ComputingCompany outings | Health care | In-office meals | Paid time off | Parental leaveSenior-level Full TimeBoston, MA; Boston, MA; Boston, MA; …9h ago