Kafka Developer/ Engineer
Minneapolis, MN 
Share
Posted 34 months ago
Position No Longer Available
Email Job 
Position No Longer Available
Email Job
Job Description
Position Summary
  • Follows company software development lifecycle to design, code, configure, test, debug, and document system and application programs.
  • Assists in preparing technical design specifications based on functional requirements and analysis documents to customize software to meet application requirements.
  • Reviews functional requirements, analysis and design documents and provides feedback. Collaborates with other development staff to achieve quality and consistency.
  • Participates in architecture, design and code reviews. .
  • Develops and maintains operational and system level documentation.
  • Analyzes systems specifications and designs, develops, modifies, and installs highly complex and customized software.
  • Actively participate in the escalation of live errors and service problems to limit downtime and resolve problems. Recognize and solve inconsistencies in the detailed technical specifications and propose changes.
Skills
  • Developer: Expert
  • Software Developer: Expert
Description
  • A Kafka developer/engineer has a combination of technical skills, communication skills and business knowledge.
  • The developer should be able to work on multiple medium to large projects.
  • The successful candidate will have excellent technical skills (Apache/Confluent Kafka, Big Data technologies) and also will be able to take oral and written business requirements and develop efficient code to meet set deliverable.
Responsibilities
  • Participate in the development, enhancement and maintenance of web applications both as an individual contributor and as a team member.
  • Leading in the identification, isolation, resolution and communication of problems within the production environment.
  • Leading developer and applying technical skills Apache/Confluent Kafka, Big Data technologies Design recommend best approach suited for data movement from different sources to HDFS using Apache/Confluent Kafka
  • Performs independent functional and technical analysis for major projects supporting several corporate initiatives Communicate and Work with IT partners and user community with various levels from Sr Management to detailed developer to business SME for project definition . Works on multiple platforms and multiple projects concurrently.
  • Performs code and unit testing for complex scope modules, and projects Physical deployment of infrastructure across multiple environments
  • Optimization and tuning Standards and patterns development User guide development and training overviews for supporting teams Provide troubleshooting and best practices methodology for development teams
  • Process automation and new application on-boarding Design monitoring solutions and baseline statistics reporting to support the implementation
  • Level 3 support for development teams that are utilizing the platform Planning and execution of infrastructure projects as well as on-boarding of new application development projects
Qualifications
  • Provide expertise and hands on experience working on Kafka connect using schema registry in a very high volume environment (~900 Million messages) Provide expertise in Kafka brokers, zookeepers, KSQL, KStream and Kafka Control center.
  • Provide expertise and hands on experience working on AvroConverters, JsonConverters, and StringConverters.
  • Provide expertise and hands on experience working on Kafka connectors such as MQ connectors, Elastic Search connectors, JDBC connectors, File stream connector, JMS source connectors, Tasks, Workers, converters, Transforms.
  • Provide expertise and hands on experience on custom connectors using the Kafka core concepts and API. Working knowledge on Kafka Rest proxy.
  • Ensure optimum performance, high availability and stability of solutions. Create topics, setup redundancy cluster, deploy monitoring tools, alerts and has good knowledge of best practices.
  • Create stubs for producers, consumers and consumer groups for helping onboard applications from different languages/platforms.
  • Leverage current ecosystem knowledge to design, and develop capabilities to deliver our solutions using Spark, Scala, Python, Hive, Kafka and other things in the Hadoop ecosystem.
  • Experience with RDBMS systems, Use automation tools like provisioning using Jenkins and Gitlab Ability to perform data related benchmarking, performance analysis and tuning.
  • Strong skills in In-memory applications, Database Design, Data Integration. 5+ years of experience with Apache Kafka or Confluent Kafka 5+ years of experience with Data Integrations 6+ years relevant experiences
  • Bachelor's Degree Required Masters Preferred
,

 

Read More
Position No Longer Available
Job Summary
Company
Horizontal Talent
Start Date
As soon as possible
Employment Term and Type
Regular, Full Time
Required Experience
5+ years
Email this Job to Yourself or a Friend
Indicates required fields