< Back to Resource Library HealthData Talks: Vendor Provided Data In this episode, host, Shannon Larkin, and Systems Analyst Manager, Alli Hysell at Harmony Healthcare IT, discuss managing incoming and outgoing data for conversions and archives. [00:02.70] – [00:15.01] Welcome to HealthData Talks where industry experts offer bite sized tips and trends for managing legacy data. Thank you for joining us. I’m Shannon Larkin with Harmony Healthcare IT and at Harmony, our specialty is working with legacy data. We’ve been focusing on that in healthcare for the past 17 years. And the thing is legacy data isn’t always the easiest thing to get. There’s aging out of production software and servers that can sometimes pose real challenges for technicians. So, that’s why we’ve asked Ally Hysell, our System Analyst Manager at Harmony to join us today. So, Alli, thanks for being here. Thanks, Shannon. Happy to join today. [00:48.52] – [01:29.21] So I know you’re the right person to talk about legacy data acquisition, but to get us started, why don’t you give our audience some background? You know, on yourself, your role and your team. Yeah, absolutely. So, I’m a local here in South Bend. I live here with my husband and our son who will be two at the end of this month. I’ve been here at Harmony for a little over five years and I oversee the Systems Analyst Team who primarily is responsible for all incoming and outgoing data. Our team primarily coordinates with our clients and their vendors on expected deliverables, which includes the format of their data, their timing and the confirmation of their overall alignment of the scope. [01:31.95] – [02:50.28] So, this is a definitely a critical role. It’s like the starting point for bringing data into our environment. So, it can be but transformed, converted stored right to fulfill whatever scope of work we’ve contracted for. So, tell us how this works. Most often is your team extracting the data directly from a legacy system? Is the data provided to us from that legacy vendor? Just kind of talk about how we get started. Yeah, absolutely. So, sometimes we are contracted to do the the legacy extraction. Primarily, we do see that we are often working with the legacy vendor to provide us the data and data is typically delivered to us one of three ways, all of which are equally secure. That transfer method mostly depends on the total size of the data that needs to be moved. And any data that is less than one terabyte, we typically recommend utilizing SFTP which is secure file transfer protocol. That’s typically utilizing an application such as FileZilla when SP or go anywhere for any data totally totaling data size larger than a terabyte. We typically recommend sending an external encrypted USB hard drive. [02:51.05] – [04:25.64] Let me stop you right there because I know Harmony works with some of the largest health systems in the nation. So, I would imagine that we’re seeing data sizes in excess of a terabyte quite a bit. So, can you comment on typical data sizes maybe and then maybe expand on the hard drive process a little bit? Yeah, absolutely. So, our data size is vary astronomical sizes. So, typically practice management systems we can see in megabytes to gigabytes. Those systems are typically on the smaller side. Whereas our acute clinical systems for larger hospitals, those are where we start to see larger sizes where we see closer to the terabytes. So, those could be 10, 50, even at the 200 terabytes worth of data and external images. So, in terms of our hard drive, so we typically utilize those for our larger projects. So, our larger terabyte transfers for our data sets, our go to brand is APRicorn. So, for some of those key features or that hard drive include a 256- Bit AES hardware encryption, which basically just equates to two layers of added encryption. You are also provided a pin to unlock the device utilizing an external keypad on the drive. And one additional security feature includes an unattended auto lock set which sets the drive to a lock after a period of inactivity for extra added security. [04:26.45] – [05:04.81] So, just out of curiosity, how are those hard drives shipped? It sounds like the device itself is very secure. But I’m just wondering how the precious protected health information cargo makes its way from the client site to our physical site securely. Yeah, so, absolutely. So, we ship our hard drives in a secure case with a custom insert for each drive and it’s cabling. We’ve recently made the change in our shipping to ensure the security and the durability of our transporting of the physical hardware. But it also helps us reduce the our carbon footprint. That’s interesting. [05:06.92] – [05:48.19] So, you mentioned I know I got us off track here with the hard drive, but I find that kind of interesting. So, you originally mentioned three ways data gets delivered. So, what’s our last method then? So, our last method is our cloud storage transfer. So, this is where our clients utilize their existing cloud storage such as AWS Azure or GCP, which is Google Cloud Platform where they are able to provide us connection credentials to allow us to securely download their data utilizing that connection information. And that’s where we’re able to securely transfer their data or external images. [05:48.75] – [06:41.85] So, this method seems really logical to me. So, do you see this transfer method happening more often as hospitals transition to the cloud? And, if so, is there one platform of the ones you mentioned, the big three that emerges is more prevalent? Yeah, absolutely. So, a few years back, we ran into a few cloud transfer request maybe once every three times a year. Nowadays, I see it at least twice a month. You know, our larger hospital and enterprise clients are investing in cloud storage and utilize that storage to their advantage as they look to archive their data. In terms of, you know, one cloud storage platform to another, I would say kind of the big three are again, you know, AWS or GCP. Those are probably the top two I see most often. [06:43.07] – [07:37.81] So, we’ve covered the methods for data delivery. Let’s say we have a client that implements a new EHR and they’re ready to archive the legacy systems that EHR just displaced. Maybe talk to us about the process and when and how your team engages in that project. Well, that’s a good question. I think about it as a kind of a ticking clock. It starts pretty much as soon as the client engages their vendor for a date extraction. And the Systems and the Analyst Team is often engaged along the way to ensure that the expected distraction deliver often aligns with the appropriate format. So, we often help kind of navigate through any technical conversations with the vendor and the client and this can be anywhere between a few weeks to several months, really just varies between vendor to vendor. [07:38.80] – [08:58.47] So, what kinds of things might make that extend from weeks to months? That’s a good question. So, a few things, I think most commonly it’s going to depend on the size of the data. So, depending on your total size of the discrete data that you’re extracting and the total size of your external images. So, if it’s a few megabytes to gigabytes may take that, you know, 4 to 6 weeks. If you’re looking at a larger acute clinical system where we’re looking at terabytes worth of data, that might range for a couple more months where in some cases, it might take 3 to 6 more months. You might also need to look at the the database platform size that will also play a factor where it’s going to determine the overall format of the deliverable where that will play a role in in the length of time, it’s going to take your vendor to actually extract that. And I would say that the most challenging is when the clients data is held in a multi-tenant vendor hosted database. And that’s usually where we see extraction times usually take the longest because the vendor often has to perform their work after hours, so it does not impact their other tenants. [09:00.30] – [ 10:39.91] So, I’m kind of surprised at the time frames and there is an information blocking provision in the 21st Century Cures Act, right? So, even if some of these factors you’re mentioning might slow the data acquisition process down, you’re ultimately always gonna be able to get at the data, right? Because the legacy vendors just have to provide access to the data. Yeah. So, you know, in some cases, we’re not always able to have, you know, direct access to the data itself, but we’re always able to kind of navigate our way around it. So, in some cases, there are what we call proprietary files delivered. So, in this case, all vendors have different files or versions of an encrypted file, which is unique to them. Ultimately, those are files that we’re not able to work with unless it’s an in the lock or decrypted. For example, we often work with eClinicalWorks where they have encrypted progress notes. And if a vendor is unable to provide this um XML, which is a type of document in an unencrypted format, the alternative is to engage our cross functional team, which is our data automation specialists who utilize their role product, automated processing tools to capture that data on the front-end of the application to mimic the actions of the front-end user. So, ultimately, we won’t necessarily if they’re not able to provide us access to the data, either delivering that to us, and we’re not able to provide us access to the back end of the data, we definitely have the tools to kind of work our way around it. [10:42.42] – [12:03.89] So, Harmony archives, hundreds and hundreds of legacy systems each year, how would you characterize the percentage on how many data extractions go, let’s say, smoothly versus not smoothly? In general, my team works effectively on their day-to-day items. I think the big thing is being proactively engaged to plan and emphasize the importance of communication, you know, a typical day for a Systems Analyst could include chatting with a client about dating credentialing information to a vendor’s SFTP site to, you know, transfer the data or working on a troubleshooting call with a vendor to review an index file that maybe was delivered without header information. So, I think despite some of these challenges, we’re always working with our clients on a path forward. So, you know, I think at the, the start of all of our products, Harmony conducts the technical key decisions and planning call right after the kickoff and at that session, you’ll meet one on one with our Systems Analyst. And we’ll confirm, you know, the optimal data transfer method kind of map out when, where and who on the data of delivery. And you know, I always highly encourage all of our clients to invite their vendor to their meeting at that time. That makes sense. [12:04.34] – [13:05.61] What kind of background do the System Analysts on your team have technically like what would your ideal candidate look like if you were hiring your next Systems Analyst? Oh I like this question. So, for Systems Analyst, you know, I often have a mixed bag of experience. I think the ideal candidate has an experience, has experience with, you know, database management, overall data extraction but can also kind of put on their general IT admin hat and dive into some troubleshooting with an LDAP issue. You know, we’re often dealing with a wide variety of different database platforms such as Db2, Sybase, Oracle, Postgres, and FoxPro. And that’s just to name a few. So, this requires the SA to kind of, you know, sometimes act as a technical liaison with our Project Management Team, which is crucial, you know, when translating technical challenge to our clients for just general next steps. Crucial for sure. [13:07.64] – [14:05.52] I think Harmony is pretty lucky to have you at the home to manage that team and just the data acquisition process overall so that, you know, the ata specialists at Harmony can complete the data conversions and the archives that we’re contracting for and that, you know, just keeps patient and employee information safe the entire time. So, Ally, I’m so glad you were able to carve out some time and join us today. Thank you very much. Yeah. Thank you so much for having me today. Yep. I think we learned a lot about the data extraction process and how we’re handling it. So, to our audience, thank you for joining us and be sure to tune in next time for another discussion about legacy data in health care. That’s it for this session of HealthData Talks check out helpful resources at harmonyhit.com and follow us in your favorite podcast app to catch future episodes. We’ll see you next time. Subscribe You can subscribe to the HealthData Talks Podcast on Spotify, Amazon Music, Apple Podcasts and more. Transcript [00:02.70] – [00:15.01] Welcome to HealthData Talks where industry experts offer bite sized tips and trends for managing legacy data. Thank you for joining us. I’m Shannon Larkin with Harmony Healthcare IT and at Harmony, our specialty is working with legacy data. We’ve been focusing on that in healthcare for the past 17 years. And the thing is legacy data isn’t always the easiest thing to get. There’s aging out of production software and servers that can sometimes pose real challenges for technicians. So, that’s why we’ve asked Ally Hysell, our System Analyst Manager at Harmony to join us today. So, Alli, thanks for being here. Thanks, Shannon. Happy to join today. [00:48.52] – [01:29.21] So I know you’re the right person to talk about legacy data acquisition, but to get us started, why don’t you give our audience some background? You know, on yourself, your role and your team. Yeah, absolutely. So, I’m a local here in South Bend. I live here with my husband and our son who will be two at the end of this month. I’ve been here at Harmony for a little over five years and I oversee the Systems Analyst Team who primarily is responsible for all incoming and outgoing data. Our team primarily coordinates with our clients and their vendors on expected deliverables, which includes the format of their data, their timing and the confirmation of their overall alignment of the scope. [01:31.95] – [02:50.28] So, this is a definitely a critical role. It’s like the starting point for bringing data into our environment. So, it can be but transformed, converted stored right to fulfill whatever scope of work we’ve contracted for. So, tell us how this works. Most often is your team extracting the data directly from a legacy system? Is the data provided to us from that legacy vendor? Just kind of talk about how we get started. Yeah, absolutely. So, sometimes we are contracted to do the the legacy extraction. Primarily, we do see that we are often working with the legacy vendor to provide us the data and data is typically delivered to us one of three ways, all of which are equally secure. That transfer method mostly depends on the total size of the data that needs to be moved. And any data that is less than one terabyte, we typically recommend utilizing SFTP which is secure file transfer protocol. That’s typically utilizing an application such as FileZilla when SP or go anywhere for any data totally totaling data size larger than a terabyte. We typically recommend sending an external encrypted USB hard drive. [02:51.05] – [04:25.64] Let me stop you right there because I know Harmony works with some of the largest health systems in the nation. So, I would imagine that we’re seeing data sizes in excess of a terabyte quite a bit. So, can you comment on typical data sizes maybe and then maybe expand on the hard drive process a little bit? Yeah, absolutely. So, our data size is vary astronomical sizes. So, typically practice management systems we can see in megabytes to gigabytes. Those systems are typically on the smaller side. Whereas our acute clinical systems for larger hospitals, those are where we start to see larger sizes where we see closer to the terabytes. So, those could be 10, 50, even at the 200 terabytes worth of data and external images. So, in terms of our hard drive, so we typically utilize those for our larger projects. So, our larger terabyte transfers for our data sets, our go to brand is APRicorn. So, for some of those key features or that hard drive include a 256- Bit AES hardware encryption, which basically just equates to two layers of added encryption. You are also provided a pin to unlock the device utilizing an external keypad on the drive. And one additional security feature includes an unattended auto lock set which sets the drive to a lock after a period of inactivity for extra added security. [04:26.45] – [05:04.81] So, just out of curiosity, how are those hard drives shipped? It sounds like the device itself is very secure. But I’m just wondering how the precious protected health information cargo makes its way from the client site to our physical site securely. Yeah, so, absolutely. So, we ship our hard drives in a secure case with a custom insert for each drive and it’s cabling. We’ve recently made the change in our shipping to ensure the security and the durability of our transporting of the physical hardware. But it also helps us reduce the our carbon footprint. That’s interesting. [05:06.92] – [05:48.19] So, you mentioned I know I got us off track here with the hard drive, but I find that kind of interesting. So, you originally mentioned three ways data gets delivered. So, what’s our last method then? So, our last method is our cloud storage transfer. So, this is where our clients utilize their existing cloud storage such as AWS Azure or GCP, which is Google Cloud Platform where they are able to provide us connection credentials to allow us to securely download their data utilizing that connection information. And that’s where we’re able to securely transfer their data or external images. [05:48.75] – [06:41.85] So, this method seems really logical to me. So, do you see this transfer method happening more often as hospitals transition to the cloud? And, if so, is there one platform of the ones you mentioned, the big three that emerges is more prevalent? Yeah, absolutely. So, a few years back, we ran into a few cloud transfer request maybe once every three times a year. Nowadays, I see it at least twice a month. You know, our larger hospital and enterprise clients are investing in cloud storage and utilize that storage to their advantage as they look to archive their data. In terms of, you know, one cloud storage platform to another, I would say kind of the big three are again, you know, AWS or GCP. Those are probably the top two I see most often. [06:43.07] – [07:37.81] So, we’ve covered the methods for data delivery. Let’s say we have a client that implements a new EHR and they’re ready to archive the legacy systems that EHR just displaced. Maybe talk to us about the process and when and how your team engages in that project. Well, that’s a good question. I think about it as a kind of a ticking clock. It starts pretty much as soon as the client engages their vendor for a date extraction. And the Systems and the Analyst Team is often engaged along the way to ensure that the expected distraction deliver often aligns with the appropriate format. So, we often help kind of navigate through any technical conversations with the vendor and the client and this can be anywhere between a few weeks to several months, really just varies between vendor to vendor. [07:38.80] – [08:58.47] So, what kinds of things might make that extend from weeks to months? That’s a good question. So, a few things, I think most commonly it’s going to depend on the size of the data. So, depending on your total size of the discrete data that you’re extracting and the total size of your external images. So, if it’s a few megabytes to gigabytes may take that, you know, 4 to 6 weeks. If you’re looking at a larger acute clinical system where we’re looking at terabytes worth of data, that might range for a couple more months where in some cases, it might take 3 to 6 more months. You might also need to look at the the database platform size that will also play a factor where it’s going to determine the overall format of the deliverable where that will play a role in in the length of time, it’s going to take your vendor to actually extract that. And I would say that the most challenging is when the clients data is held in a multi-tenant vendor hosted database. And that’s usually where we see extraction times usually take the longest because the vendor often has to perform their work after hours, so it does not impact their other tenants. [09:00.30] – [ 10:39.91] So, I’m kind of surprised at the time frames and there is an information blocking provision in the 21st Century Cures Act, right? So, even if some of these factors you’re mentioning might slow the data acquisition process down, you’re ultimately always gonna be able to get at the data, right? Because the legacy vendors just have to provide access to the data. Yeah. So, you know, in some cases, we’re not always able to have, you know, direct access to the data itself, but we’re always able to kind of navigate our way around it. So, in some cases, there are what we call proprietary files delivered. So, in this case, all vendors have different files or versions of an encrypted file, which is unique to them. Ultimately, those are files that we’re not able to work with unless it’s an in the lock or decrypted. For example, we often work with eClinicalWorks where they have encrypted progress notes. And if a vendor is unable to provide this um XML, which is a type of document in an unencrypted format, the alternative is to engage our cross functional team, which is our data automation specialists who utilize their role product, automated processing tools to capture that data on the front-end of the application to mimic the actions of the front-end user. So, ultimately, we won’t necessarily if they’re not able to provide us access to the data, either delivering that to us, and we’re not able to provide us access to the back end of the data, we definitely have the tools to kind of work our way around it. [10:42.42] – [12:03.89] So, Harmony archives, hundreds and hundreds of legacy systems each year, how would you characterize the percentage on how many data extractions go, let’s say, smoothly versus not smoothly? In general, my team works effectively on their day-to-day items. I think the big thing is being proactively engaged to plan and emphasize the importance of communication, you know, a typical day for a Systems Analyst could include chatting with a client about dating credentialing information to a vendor’s SFTP site to, you know, transfer the data or working on a troubleshooting call with a vendor to review an index file that maybe was delivered without header information. So, I think despite some of these challenges, we’re always working with our clients on a path forward. So, you know, I think at the, the start of all of our products, Harmony conducts the technical key decisions and planning call right after the kickoff and at that session, you’ll meet one on one with our Systems Analyst. And we’ll confirm, you know, the optimal data transfer method kind of map out when, where and who on the data of delivery. And you know, I always highly encourage all of our clients to invite their vendor to their meeting at that time. That makes sense. [12:04.34] – [13:05.61] What kind of background do the System Analysts on your team have technically like what would your ideal candidate look like if you were hiring your next Systems Analyst? Oh I like this question. So, for Systems Analyst, you know, I often have a mixed bag of experience. I think the ideal candidate has an experience, has experience with, you know, database management, overall data extraction but can also kind of put on their general IT admin hat and dive into some troubleshooting with an LDAP issue. You know, we’re often dealing with a wide variety of different database platforms such as Db2, Sybase, Oracle, Postgres, and FoxPro. And that’s just to name a few. So, this requires the SA to kind of, you know, sometimes act as a technical liaison with our Project Management Team, which is crucial, you know, when translating technical challenge to our clients for just general next steps. Crucial for sure. [13:07.64] – [14:05.52] I think Harmony is pretty lucky to have you at the home to manage that team and just the data acquisition process overall so that, you know, the ata specialists at Harmony can complete the data conversions and the archives that we’re contracting for and that, you know, just keeps patient and employee information safe the entire time. So, Ally, I’m so glad you were able to carve out some time and join us today. Thank you very much. Yeah. Thank you so much for having me today. Yep. I think we learned a lot about the data extraction process and how we’re handling it. So, to our audience, thank you for joining us and be sure to tune in next time for another discussion about legacy data in health care. That’s it for this session of HealthData Talks check out helpful resources at harmonyhit.com and follow us in your favorite podcast app to catch future episodes. We’ll see you next time. Speakers Host: Shannon Larkin, VP of Marketing and Business Development at Harmony Healthcare IT, utilizes her 25+ years of health IT experience to connect healthcare organizations with a team of experts that consolidate and modernize data storage to reduce cost and risk.Guest Allison Hysell, has worked with Harmony Healthcare for 5 years within the Systems Analyst Department. She graduated from Saint Mary’s College with a bachelor’s degree in management and information systems with a passion to pursue accessible technology. She currently reside in South Bend, IN with my family. In her free time, she enjoys traveling to various local state parks in Michiana. Suggested For You HealthData Talks: DICOM Viewer for an Active Archive HealthData Talks: Cures Act & Consumer Access Tate Chronicles: Legacy Data Management, 21st Century Cures Act ft. Jim Hammer HealthData Talks: Data Procurement & Extraction HealthData Talks: Mitigating Legacy Data Risks Was the Resource Helpful? Talk to the experts. Harmony Healthcare IT is an award-winning data management firm with a proven ability to extract, migrate and archive data with 100% integrity.