Embodiments relate to a system, program product, and method for optimizing the throughput of an archival application through storage volume and file selection and assignment of a finite number of storage controller data movement threads associated with a plurality of storage controllers. Data directed to be transferred from one or more storage controllers to non-cloud-based storage is transferred through standard I/O features. Data directed to be transferred from the storage controllers to cloud object storage devices is managed through an archival application that manages the finite number of storage controller data movement threads to provide efficient and effective transfer of the data.
Legal claims defining the scope of protection. Each claim is shown in both the original legal language and a plain English translation.
1. A computer system comprising: one or more processing devices; a plurality of storage devices communicatively coupled with the one or more processing devices, wherein the plurality of storage devices comprises one or more first storage devices and one or more second storage devices; one or more memory devices communicatively coupled with the one or more processing devices; and one or more archival managers communicatively coupled with the one or more memory devices, the one or more archival managers configured to: determine data designated for transfer from a logical volume associated with the one or more first storage devices to the one or more second storage devices, wherein the data in the logical volume includes one or more data files; distinguish the one or more data files designated for transfer as one of a first data type and a second data type, the first data type configured to use an assignment of one thread resource of a plurality of thread resources associated with the one or more first storage devices to execute the transfer of the one or more data files of the first data type, thereby defining an assigned thread resource, the second data type configured to transfer without the assigned thread resource; determine one or more thread resources of the plurality of thread resources available for transferring the one or more data files of the first data type as the assigned thread resource; and transfer, individually, each data file of the first data type in the logical volume designated for transfer, from the one or more first storage devices to the one or more second storage devices through each assigned thread resource.
A computer system is designed to manage data transfer between storage devices, addressing inefficiencies in archival processes. The system includes processing devices, multiple storage devices (divided into first and second storage groups), memory devices, and archival managers. The archival managers identify data in a logical volume of the first storage devices that needs to be transferred to the second storage devices. The data consists of multiple files, which are categorized into two types. Files of the first type are transferred using a dedicated thread resource from the first storage devices, while files of the second type are transferred without such a dedicated resource. The system evaluates available thread resources to assign them to the first-type files. Each first-type file is then transferred individually from the first storage devices to the second storage devices using its assigned thread resource. This approach optimizes resource allocation and improves transfer efficiency by dynamically managing thread assignments based on file type. The system ensures that high-priority or resource-intensive transfers are handled separately, while other transfers proceed without dedicated resources. This method enhances performance and reduces bottlenecks in data archival operations.
2. The system of claim 1 , further comprising the one or more archival managers configured to: process each data file of the one or more data files of the first data type in the logical volume designated for transfer; obtain, individually, for each data file of the first data type in the logical volume designated for transfer, the assigned thread resource; and release the assigned thread resource for each data file of the first data type upon completion of the transfer thereof, wherein obtainment of the assigned thread resource, transfer of each data file of the first data type in the logical volume designated for transfer, and release of the assigned thread resource are performed in a serialized manner.
This invention relates to data transfer systems, specifically improving the handling of data files during archival processes. The problem addressed is inefficient resource utilization and potential bottlenecks when transferring large volumes of data, particularly when different types of data files require distinct processing approaches. The system includes one or more archival managers that process data files of a first data type within a designated logical volume. Each file is handled individually, with a dedicated thread resource assigned to it for the duration of the transfer. The system ensures that the thread resource is released immediately after the file transfer is complete. The key innovation is that the assignment, transfer, and release of thread resources for these files occur in a serialized manner, meaning each step is completed for one file before moving to the next. This prevents resource contention and ensures orderly processing, particularly when dealing with multiple files of the same type. The serialized approach helps maintain system stability and predictability, especially in environments where concurrent transfers could lead to conflicts or performance degradation. The system is designed to optimize resource allocation while ensuring reliable data transfer operations.
3. The system of claim 1 , further comprising the one or more archival managers configured to: determine no thread resources are available to transfer a first data file of the first data type in the logical volume designated for transfer; place a transfer request for the first data file of the first data type in the logical volume designated for transfer into a data transfer queue; and reattempt obtaining the assigned thread resource for transferring the first data file of the first data type in the logical volume designated for transfer.
This invention relates to data archival systems, specifically addressing the challenge of efficiently managing data transfers when system resources are constrained. The system includes one or more archival managers that handle the transfer of data files from a logical volume designated for archival. When no thread resources are available to transfer a first data file of a specific data type, the archival manager places a transfer request for that file into a data transfer queue. The system then periodically reattempts to obtain an assigned thread resource to process the queued file. This approach ensures that data transfers are managed without resource contention, preventing system bottlenecks while maintaining orderly processing of archival tasks. The system dynamically monitors resource availability and prioritizes transfers based on queuing mechanisms, optimizing throughput in environments with limited processing threads. This solution is particularly useful in large-scale data storage systems where efficient resource allocation is critical to maintaining performance and reliability.
4. The system of claim 3 , further comprising the one or more archival managers configured to: maintain the transfer request for the first data file of the first data type in the logical volume designated for transfer in the data transfer queue for a predetermined period of time; and abandon the attempted transfer of the first data file of the first data type in the logical volume designated for transfer.
A data management system includes components for transferring data files between storage locations, particularly for archiving purposes. The system addresses challenges in efficiently managing data transfers, such as ensuring reliable and timely movement of files while handling potential transfer failures. The system includes one or more archival managers that oversee the transfer process. These managers maintain a transfer request for a specific data file in a designated logical volume within a data transfer queue for a predetermined period. If the transfer attempt fails or is not completed within this time, the system abandons the transfer, preventing indefinite retention of stalled requests. This mechanism ensures that the transfer queue remains efficient and does not become cluttered with unresolved requests, improving overall system performance and reliability. The system may also include other components, such as data transfer modules and storage interfaces, to facilitate the movement of data between different storage tiers or locations. The archival managers may further prioritize transfers based on file type, age, or other criteria to optimize storage utilization and access patterns.
5. The system of claim 1 , the one or more second storage devices comprising one or more non-cloud-based storage devices, further comprising the one or more archival managers configured to: determine the logical volume includes one or more data files of the second data type designated for transfer; and process each data file of the one or more data files of the second data type in the logical volume designated for transfer including transfer all of the data files of the second data type in the logical volume designated for transfer to the one or more non-cloud-based storage devices.
A data storage system manages data files of different types, including a second data type designated for archival transfer. The system includes one or more storage devices, at least one of which is a non-cloud-based storage device, and one or more archival managers. The archival managers identify logical volumes containing data files of the second type that are marked for transfer. These managers then process each designated file, transferring all such files from the logical volume to the non-cloud-based storage devices. This ensures that specific data types are efficiently moved to designated storage locations, optimizing storage management and ensuring data is stored in the appropriate medium. The system supports automated handling of archival data, reducing manual intervention and improving reliability. The non-cloud-based storage devices may include on-premises or local storage solutions, providing control over data placement and compliance with storage policies. The archival managers handle the transfer process, ensuring complete and accurate movement of designated files while maintaining data integrity. This approach is particularly useful for organizations requiring strict data governance or those with regulatory constraints on cloud storage.
6. The system of claim 1 , the one or more second storage devices comprising one or more non-cloud-based storage devices, wherein distinguishment of the data files designated for transfer as one of the first data type and the second data type comprises the one or more archival managers to: determine that all of the data files in the logical volume designated for transfer is the second data type; and transfer all of the data files in the logical volume designated for transfer to the one or more non-cloud-based storage devices.
This invention relates to data storage systems that manage the transfer of data files between different storage devices, particularly distinguishing between different types of data for optimized storage allocation. The system addresses the challenge of efficiently transferring data files to appropriate storage destinations based on their type, ensuring that data is stored in the most suitable location while minimizing unnecessary transfers. The system includes one or more archival managers that classify data files into at least two types: a first data type and a second data type. The archival managers determine whether all data files within a logical volume designated for transfer belong to the second data type. If so, the system transfers all files in that logical volume to one or more non-cloud-based storage devices, such as on-premises or local storage systems. This approach ensures that data files of the second type are stored in non-cloud storage, which may be preferred for compliance, security, or performance reasons. The system avoids unnecessary transfers by evaluating the entire logical volume at once, rather than processing individual files, improving efficiency in large-scale storage environments. The invention is particularly useful in enterprise storage systems where data must be distributed across different storage tiers based on predefined criteria.
7. The system of claim 1 , the one or more second storage devices comprising one or more cloud-based storage devices, wherein distinguishment of the data files designated for transfer as one of the first data type and the second data type includes a determination that all of the data files designated for transfer are the first data type, further comprising the one or more archival managers configured to: obtain a temporary exclusive lock on the assigned thread resource; transfer all of the data files on the logical volume designated for transfer to the one or more cloud-based storage devices through the assigned thread resource; and release the lock on the assigned thread resource.
This invention relates to data transfer systems, specifically for managing the transfer of data files from a logical volume to cloud-based storage devices. The system addresses the challenge of efficiently transferring large volumes of data while ensuring data integrity and minimizing resource contention. The system includes one or more storage devices, where at least one is a cloud-based storage device, and an archival manager that handles the transfer process. The archival manager distinguishes data files designated for transfer as either a first data type or a second data type, with the first data type being the only type transferred in this scenario. The archival manager obtains a temporary exclusive lock on a thread resource to prevent conflicts during the transfer. All data files on the logical volume designated for transfer are then moved to the cloud-based storage devices through the assigned thread resource. Once the transfer is complete, the lock on the thread resource is released, allowing other operations to proceed. This approach ensures that data transfers are performed atomically and without interference from concurrent processes, improving reliability and performance in distributed storage environments.
8. The system of claim 7 , wherein the determination of the thread resources available for transferring the data further comprises the one or more archival managers configured to: determine no thread resources are available to transfer the data files of the logical volume designated for transfer; place a transfer request for the data files of the logical volume designated for transfer into a data transfer queue; and reattempt obtaining the assigned thread resource for transferring the data files of the logical volume designated for transfer.
In the field of data storage and management, particularly in systems handling large-scale data transfers, a challenge arises when thread resources are insufficient to immediately transfer designated data files. This can lead to delays in data archival or migration, impacting system efficiency and performance. The invention addresses this problem by implementing a system with one or more archival managers that dynamically manage thread resources for data transfers. When no thread resources are available to transfer data files from a designated logical volume, the system places a transfer request for those files into a data transfer queue. The system then periodically reattempts to obtain an assigned thread resource for the queued transfer. This approach ensures that data transfers are not abandoned but are instead managed efficiently, even under high system load. The system may also prioritize certain transfers based on factors such as urgency or file size, optimizing resource allocation. By queuing and reattempting transfers, the system maintains data transfer operations without requiring immediate resource availability, improving overall system reliability and throughput.
9. A computer program product for co-processing a plurality of dependent systems with a finite number of processing threads, the computer program product comprising: one or more computer readable storage media; and program instructions collectively stored on the one or more computer-readable storage media, the program instructions comprising: program instructions to determine data designated for transfer from a logical volume associated with one or more first storage devices to one or more second storage devices, wherein the data in the logical volume includes one or more data files; program instructions to distinguish the one or more data files designated for transfer as one of a first data type and a second data type, the first data type configured to use an assignment of one thread resource of a plurality of thread resources to execute the transfer of the one or more data files of the first data type, thereby defining an assigned thread resource, the second data type configured to transfer without the assigned thread resource; program instructions to determine a threshold value for the logical volume, the threshold value representative of a percentage of data files corresponding to the first data type in at least one previous processing event of the logical volume; program instructions to determine the threshold value is not exceeded; program instructions to determine one or more thread resources of the plurality of thread resources available for transferring the one or more data files of the first data type as the assigned thread resource; and program instructions to process each data file of the one or more data files of the first data type in the logical volume designated for transfer comprising: program instructions to obtain, individually, for each data file of the first data type in the logical volume designated for transfer, the assigned thread resource; and program instructions to transfer, individually, each data file of the first data type in the logical volume designated for transfer, from the one or more first storage devices to the one or more second storage devices, through each assigned thread resource.
This invention relates to optimizing data transfer between storage devices in a computing system with limited processing threads. The problem addressed is efficiently managing the transfer of dependent data files while avoiding thread resource contention and ensuring timely completion. The system distinguishes between two data types: a first type requiring dedicated thread assignment for transfer and a second type that can transfer without thread allocation. The program determines which files belong to each type and checks if the percentage of first-type files in previous transfers remains below a predefined threshold. If the threshold is not exceeded, available threads are allocated to transfer first-type files individually, while second-type files transfer without dedicated threads. This approach ensures thread resources are used efficiently, preventing bottlenecks in systems with finite processing capacity. The solution is particularly useful in environments where multiple dependent systems must co-process data without excessive thread contention.
10. The computer program product of claim 9 , further comprising program instructions to: determine no thread resources are available to transfer a first data file of the first data type in the logical volume designated for transfer; place a transfer request for the first data file of the first data type in the logical volume designated for transfer into a data transfer queue; reattempt obtaining the assigned thread resource for transferring the first data file of the first data type in the logical volume designated for transfer; maintain the transfer request for the first data file of the first data type in the logical volume designated for transfer in the data transfer queue for a predetermined period of time; and abandon the attempted transfer of the first data file of the first data type in the logical volume designated for transfer.
In the field of data transfer management, particularly in systems handling multiple data types and logical volumes, a challenge arises when thread resources are insufficient to transfer designated files. This invention addresses the problem by implementing a queuing and retry mechanism for data transfers when resources are unavailable. The system first identifies that no thread resources are available to transfer a specific data file of a particular type within a designated logical volume. Instead of failing immediately, the system places the transfer request into a data transfer queue. The system then periodically reattempts to obtain the necessary thread resources for the transfer. If the transfer request remains in the queue for a predetermined period without successful resource allocation, the system abandons the transfer attempt. This approach ensures efficient resource utilization by managing transfer requests dynamically, preventing system overload, and maintaining data transfer reliability. The solution is particularly useful in high-demand environments where thread resources are limited and must be allocated strategically to prioritize critical transfers.
11. The computer program product of claim 9 , the one or more second storage devices including one or more non-cloud-based storage devices, further comprises program instructions to execute an operation selected from the group consisting of: determine the logical volume includes one or more data files of the second data type designated for transfer, and process each data file of the one or more data files of the second data type in the logical volume designated for transfer including transfer all of the data files of the second data type in the logical volume designated for transfer to the one or more non-cloud-based storage devices; and determine that all of the data files in the logical volume designated for transfer is the second data type and transfer all of the data files in the logical volume designated for transfer to the one or more non-cloud-based storage devices.
This invention relates to data management systems that selectively transfer data files between cloud-based and non-cloud-based storage devices. The system addresses the challenge of efficiently managing data storage by distinguishing between different types of data files and transferring them to appropriate storage locations based on their designated types. The system includes a logical volume that contains data files of various types, including a second data type designated for transfer to non-cloud-based storage devices. The system determines whether the logical volume includes one or more data files of the second data type and processes them accordingly. If individual files of the second data type are identified within the logical volume, those specific files are transferred to the non-cloud-based storage devices. Alternatively, if all files in the logical volume are of the second data type, the entire logical volume is transferred to the non-cloud-based storage devices. This selective transfer mechanism ensures that only the relevant data files are moved, optimizing storage utilization and reducing unnecessary data transfers. The system leverages program instructions to execute these operations, ensuring efficient and automated data management.
12. The computer program product of claim 9 , the one or more second storage devices including one or more cloud-based storage devices, wherein all of the data files designated for transfer are the first data type, further comprising program instructions to: obtain a temporary exclusive lock on the assigned thread resource; transfer all of the data files on the logical volume designated for transfer to the one or more cloud-based storage devices through the assigned thread resource; and release the lock on the assigned thread resource.
This invention relates to data transfer systems, specifically optimizing the transfer of data files from a logical volume to cloud-based storage devices. The problem addressed is ensuring efficient and conflict-free data transfer in a multi-threaded environment where multiple processes may compete for system resources. The system includes a logical volume containing data files of a first type designated for transfer to one or more cloud-based storage devices. A thread resource is assigned to manage the transfer process. To prevent conflicts, the system obtains a temporary exclusive lock on the assigned thread resource before initiating the transfer. This lock ensures that no other process can interfere with the transfer operation. Once the lock is acquired, all data files of the first type on the logical volume are transferred to the cloud-based storage devices through the assigned thread resource. After the transfer is complete, the lock on the thread resource is released, allowing other processes to utilize it. This approach ensures that data transfers are performed atomically, without interference from other operations, improving reliability and consistency in distributed storage environments. The use of cloud-based storage devices as the destination allows for scalable and flexible data management. The temporary lock mechanism prevents race conditions and ensures that the transfer process is completed without partial or corrupted data transfers.
13. A computer-implemented method comprising: determining data designated for transfer from a logical volume associated with one or more first storage devices to one or more second storage devices, wherein the data in the logical volume includes one or more data files; distinguishing the one or more data files designated for transfer as one of a first data type and a second data type, the first data type configured to use an assignment of one thread resource of a plurality of thread resources to execute the transfer of the one or more data files of the first data type, thereby defining an assigned thread resource, the second data type configured to transfer without the assigned thread resource; determining one or more thread resources of the plurality of thread resources available for transferring the one or more data files of the first data type as the assigned thread resource; and transferring, individually, each data file of the first data type in the logical volume designated for transfer, from the one or more first storage devices to the one or more second storage devices through each assigned thread resource.
This invention relates to data transfer optimization in storage systems, specifically addressing inefficiencies in transferring data between storage devices. The method involves selecting data from a logical volume for transfer between storage devices, where the data includes multiple files. The files are categorized into two types: a first type that requires dedicated thread resources for transfer and a second type that does not. For the first data type, the method assigns available threads from a pool of thread resources to handle the transfer individually. The system identifies which threads are available and then transfers each file of the first type using its assigned thread, ensuring efficient resource utilization. The second data type is transferred without dedicated thread assignment, allowing for flexible handling. This approach optimizes performance by dynamically allocating thread resources based on file type, improving transfer efficiency and reducing bottlenecks in storage operations. The method ensures that critical data files receive dedicated processing while allowing other files to be transferred without unnecessary resource allocation.
14. The method of claim 13 , wherein processing each data file further comprises: processing each data file of the one or more data files of the first data type in the logical volume designated for transfer comprising: obtaining, individually, for each data file of the first data type in the logical volume designated for transfer, the assigned thread resource; and releasing the assigned thread source for each data file of the first data type upon completion of the transfer thereof, wherein obtaining the assigned thread resource, transferring each data file of the first data type in the logical volume designated for transfer, and releasing the assigned thread resource are performed in a serialized manner.
This invention relates to data transfer systems, specifically methods for managing thread resources during the transfer of data files of a first data type within a logical volume designated for transfer. The problem addressed is efficient resource allocation and serialization of data file transfers to prevent conflicts and ensure orderly processing. The method involves processing each data file of the first data type in the designated logical volume. For each file, a thread resource is individually obtained, ensuring that only one thread is assigned per file at a time. The file is then transferred using the assigned thread, and upon completion, the thread is released. This process is serialized, meaning each step—obtaining the thread, transferring the file, and releasing the thread—occurs sequentially for each file without overlap. This ensures that thread resources are managed efficiently, preventing contention and maintaining orderly data transfer operations. The approach is particularly useful in systems where multiple data files must be transferred in a controlled manner, such as in distributed storage or backup systems.
15. The method of claim 13 , wherein determining thread resources available for transferring the data further comprises: determining no thread resources are available to transfer a first data file of the first data type in the logical volume designated for transfer; placing a transfer request for the first data file of the first data type in the logical volume designated for transfer into a data transfer queue; and reattempting obtaining the assigned thread resource for transferring the first data file of the first data type in the logical volume designated for transfer.
In data transfer systems, efficiently managing thread resources is critical for optimizing performance, especially when handling multiple data types and logical volumes. The invention addresses the challenge of resource allocation when no thread resources are available for transferring a specific data file. The method involves determining thread availability for transferring a first data file of a first data type within a designated logical volume. If no thread resources are available, the transfer request for the first data file is placed into a data transfer queue. The system then reattempts to obtain an assigned thread resource for transferring the first data file. This approach ensures that transfer requests are not lost when resources are temporarily unavailable, improving system reliability and efficiency. The method may also involve prioritizing transfer requests based on data type or logical volume, ensuring critical data is processed first. By dynamically managing thread resources and queuing requests, the system maintains smooth data transfer operations even under high load conditions. This solution is particularly useful in environments where multiple data types and logical volumes must be managed concurrently, such as in enterprise storage systems or cloud computing platforms.
16. The method of claim 15 , wherein determining the thread resources available for transferring the data further comprises: maintaining the transfer request for the first data file of the first data type in the logical volume designated for transfer in the data transfer queue for a predetermined period of time; and abandoning the attempted transfer of the first data file of the first data type in the logical volume designated for transfer.
This invention relates to data transfer management in computing systems, specifically addressing the challenge of efficiently handling data transfers when thread resources are insufficient. The method involves managing data transfer requests for files stored in logical volumes, particularly when available thread resources are limited. When a transfer request for a first data file of a first data type in a designated logical volume cannot be immediately processed due to insufficient thread resources, the system maintains the request in a data transfer queue for a predetermined period. If the transfer cannot be completed within this time, the system abandons the attempted transfer, freeing up system resources. This approach ensures that pending transfers do not indefinitely consume system resources, improving overall system efficiency and responsiveness. The method may also involve prioritizing transfers based on file type or other criteria to optimize resource allocation. The invention is particularly useful in environments where multiple data transfers compete for limited processing resources, such as cloud storage systems or distributed computing networks. By dynamically managing transfer requests and abandoning stalled transfers, the system maintains performance and avoids resource exhaustion.
17. The method of claim 13 , wherein the second storage devices include non-cloud-based storage devices, the method further comprising: determining the logical volume includes one or more data files of the second data type designated for transfer; and processing each data file of the one or more data files of the second data type in the logical volume designated for transfer comprising transferring all of the data files of the second data type in the logical volume designated for transfer to the one or more non-cloud-based storage devices.
This invention relates to data management systems that handle different types of data across multiple storage devices, including non-cloud-based storage. The problem addressed is efficiently transferring specific data files of a designated type from a logical volume to non-cloud-based storage devices. The system identifies a logical volume containing data files of a second data type marked for transfer. It then processes these files by transferring all designated files of the second data type from the logical volume to one or more non-cloud-based storage devices. This ensures that only the relevant data files are moved, optimizing storage allocation and reducing unnecessary data transfers. The method supports selective data migration, improving storage efficiency and performance by segregating data types and directing them to appropriate storage systems. The approach is particularly useful in environments where certain data must remain on-premises or in non-cloud storage for compliance, security, or performance reasons. The system dynamically processes the designated files, ensuring seamless integration with existing storage infrastructure while maintaining data integrity and accessibility.
18. The method of claim 13 , wherein the second storage devices include one or more non-cloud-based storage devices, wherein distinguishing the data files designated for transfer is one of the first data type and the second data type comprises: determining that all of the data files in the logical volume designated for transfer is the second data type, the method further comprising: transferring all of the data files in the logical volume designated for transfer to the one or more non-cloud-based storage devices.
This invention relates to data management systems that transfer data files between storage devices, particularly distinguishing and transferring specific data types to non-cloud-based storage devices. The problem addressed is efficiently identifying and transferring data files of a particular type to designated storage locations, ensuring proper data segregation and storage optimization. The method involves a system with multiple storage devices, including non-cloud-based storage devices, and a logical volume containing data files of different types. The system distinguishes data files based on their type, with a focus on identifying files of a second data type. If all files in a designated logical volume are determined to be of the second data type, the system transfers all files in that volume to the non-cloud-based storage devices. This ensures that data of the specified type is stored in the appropriate location, improving data management and accessibility. The method may also involve additional steps such as analyzing file metadata, applying predefined rules, or using classification algorithms to determine data types. The transfer process may include encryption, compression, or other data handling techniques to ensure secure and efficient movement of files. The system may also log transfer activities for auditing and tracking purposes. This approach enhances data organization, reduces storage costs, and ensures compliance with storage policies.
19. The method of claim 13 , wherein the second storage devices include cloud-based storage devices, wherein distinguishing the data files designated for transfer is one of the first data type and the second data type comprises determining that all of the data files designated for transfer are the first data type, the method further comprising: obtaining a temporary exclusive lock on the assigned thread resource; transferring all of the data files on the logical volume designated for transfer to one or more cloud-based storage devices through the assigned thread resource; and releasing the lock on the assigned thread resource.
This invention relates to data transfer systems, specifically methods for efficiently transferring data files between storage devices, including cloud-based storage. The problem addressed is the need to optimize data transfer processes, particularly when dealing with different data types and ensuring thread resource management during transfers. The method involves distinguishing data files designated for transfer based on their type, such as first or second data types. In this specific implementation, all data files marked for transfer are of the first data type. The process includes obtaining a temporary exclusive lock on a thread resource assigned to the transfer operation. This lock ensures that the thread resource is exclusively used for the transfer, preventing conflicts or interruptions. All data files on a designated logical volume are then transferred to one or more cloud-based storage devices through the locked thread resource. Once the transfer is complete, the lock on the thread resource is released, making it available for other operations. This approach improves data transfer efficiency by ensuring thread resource exclusivity during the process, particularly when transferring data to cloud storage, and simplifies the transfer by handling all files of a single data type in a single operation.
20. The method of claim 19 , wherein determining thread resources available for transferring the data further comprises: determining no thread resources are available to transfer data files of the logical volume designated for transfer; placing a transfer request for the data files of the logical volume designated for transfer into a data transfer queue; and reattempting obtaining the assigned thread resource for transferring the data files of logical volume designated for transfer.
This invention relates to data transfer management in computing systems, specifically addressing the challenge of efficiently allocating thread resources when transferring data files from logical volumes. The system monitors available thread resources to handle data transfer tasks. When no thread resources are immediately available to transfer data files from a designated logical volume, the system places the transfer request into a data transfer queue. The system then periodically reattempts to obtain an assigned thread resource for the queued transfer. This approach ensures that data transfer operations are managed without resource contention, preventing system bottlenecks and improving overall data transfer efficiency. The method dynamically adjusts to resource availability, prioritizing queued requests based on system capacity, and ensures that all designated data files are eventually transferred without manual intervention. The solution is particularly useful in environments with high data transfer demands, such as distributed storage systems or cloud computing platforms, where efficient resource allocation is critical for performance and reliability.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
January 6, 2020
March 8, 2022
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.