Boosting efficiency and reducing infrastructure costs by 20 times for a healthcare data analytics company

The primary objectives of our collaboration were centered around empowering analysts with an efficient tool to enhance the performance, accuracy, and overall quality of their Medicare data analysis and analytics services.

So, Binariks formulated a comprehensive strategy focused on leveraging advanced technologies and optimizing data management processes. The key solutions included:

• Additional data sources: Integrated additional reliable data sources to enrich the Medicare dataset.

• Deduplication of resources: Implemented robust deduplication processes to ensure data consistency and eliminate redundancies.

• Cloud migration: Successfully migrated the data infrastructure to a more efficient cloud platform, addressing the intricate logic obscured within the previous cloud systems and optimizing the costs.

• Development of notification network: Created a well-triggered notification network to promptly alert healthcare providers of critical insights and any essential changes in specific characteristics/limits/indicators. These characteristics are assigned to the data collected from public health datasets, a particular patient's hospital admissions record, lab results, wearables data, and more. They are displayed in user-friendly dashboards to present the most comprehensive picture for further analysis.

Our project represents an unprecedented venture into the realm of "healthcare super data," as our client calls it. The intricacies of this highly complex system required meticulous attention, considering the absence of comparable products in the current market.

• For instance, the data is ingested in various formats, including CSV, HL7, and different versions of FHIR, like FHIR STU3 and FHIR R4. While some sources provided completed, enriched resources, others offered less detailed data, and sometimes, this volume varied significantly, although the resource IDs in the database seemed the same. So, we had to check and validate everything case by case.
• Also, prioritizing data accuracy, we devised a strategic plan to promptly trace and rectify discrepancies. This involved establishing robust rules on how exactly the system is supposed to handle one error or another or how to modify resources to ensure the highest quality of healthcare data.
• A daring migration from AWS to GCP FHIR storage was a pivotal moment in our journey. We moved from the database which provides a closed database solution as a FHIR server. Instead, we chose GCP FHIR storage as the main database on which we are aimed to build our solutions, so to say, the heart of the system. The decision was made that all related services should also move to GCP for convenience and consistency. The migration process is now completed. The number of GCP services is constantly expanding and will continue to do so.

• With information derived from seven different vendors, our task is to obtain, validate, and process diverse datasets. In general, we can leverage existing resources with sufficient information to generate entirely new data entities.

As of now, the system manages a staggering 20 million resources in production, terabytes of historical data, and handles diverse imports weekly, including real-time hospital data and monthly/quarterly data from open national databases.

The development process avoids ready-made solutions or frameworks, employing entirely custom code to meet unique requirements. Our transformative journey continues, shaping the landscape of healthcare data management.