Shubhangi Dwivedi

Shubhangi Dwivedi

Software Engineer 2 @ Barclays

Specializing in SIEM Log Ingestion Pipelines, Kafka Streaming, Ansible Automation & Kubernetes/OpenShift CI/CD.

Public Repos
--
Followers
--

Technical Skills

Python Apache Kafka Ansible Kubernetes OpenShift (BCP) Helm Elasticsearch Grafana Logstash / Kibana React.js FastAPI / Flask CrewAI MongoDB / SQL GitLab CI/CD

Education

B.Tech in Computer Science

Banasthali Vidyapith (CGPA: 9.10)

July 2019 – May 2023

Professional Experience

Software Engineer 2

Barclays • Pune, Maharashtra

July 2023 – Present
  • Architected an event-driven Ansible and Kafka automation framework for SCCM collections, Task Sequences, and app deployments; integrated automated ServiceNow Change Request (CR) approvals.
  • Designed and implemented a resilient Python-based log ingestion pipeline streaming Island SIEM logs into Elasticsearch via Kafka for continuous security auditing.
  • Led scheduled Ansible automation workflow streaming Adaptiva Audit data from SQL Server to Grafana every 15 mins for enterprise security compliance.
  • Engineered GitLab CI/CD pipelines deploying microservices onto OpenShift/Kubernetes with custom Helm charts.
  • Spearheaded observability initiatives by migrating distributed TravelApp logs to Elasticsearch, reducing troubleshooting time by 95%.
  • Designed full-stack automation management platform (React, Flask, SQL), decreasing engineering process delays by 90%.

Software Engineer Intern

Cretorial.ai • Remote

Oct 2022 – Feb 2023
  • Engineered web scrapers in Python for 600+ websites for large-scale data collection.
  • Applied NLP techniques for POS tagging and built OpenAI processing scripts for advanced data analytics.

Software Engineer Intern

Barclays • Pune, Maharashtra

June 2022 – July 2022
  • Built ML model predicting VM disk space usage via vROps API data to optimize resource management.
  • Developed predictive attendance model assisting in workforce planning.

Featured Personal Projects

Financial Researcher

CrewAI SERPER.dev

Built an AI-powered multi-agent financial research system using CrewAI orchestrating specialized agents for data gathering, financial analysis, and automated report generation.

Log Classification System

Python LLM / Sentence Transformers

Implemented a hybrid log classification system combining Regex, Sentence Transformers + Logistic Regression, and LLM approaches to handle varying levels of log pattern complexity.

Health Care Alert System

FastAPI Twilio SMS

Developed a healthcare vital monitoring system using FastAPI and Twilio to trigger real-time patient SMS alerts for abnormal medical readings.

GitHub Projects & Repositories

View All