US11461010B2

US11461010B2 - Data property-based data placement in a nonvolatile memory device

Info

Publication number: US11461010B2
Application number: US15/144,588
Authority: US
Inventors: Changho Choi; Jianjian Huo; Derrick Tseng; Praveen Krishnamoorthy; Hingkwan HUEN
Original assignee: Samsung Electronics Co Ltd
Current assignee: Samsung Electronics Co Ltd
Priority date: 2015-07-13
Filing date: 2016-05-02
Publication date: 2022-10-04
Anticipated expiration: 2036-05-02
Also published as: CN106354425A; JP6971542B2; TWI710949B; TW201710881A; KR20170008152A; US20170017411A1; JP2017021804A; CN106354425B; KR102541458B1

Abstract

Example embodiments are described for data property-based data placement inside a nonvolatile memory device performed by a storage controller of the nonvolatile memory device. In one aspect, the embodiments include: executing a software component on the computer device that detects at least one of an executing application and a hardware device connecting to the computing device; responsive to detecting the at least one executing application and the hardware device, searching, by the software component, a workflow repository to find a predetermined workflow associated with the at least one executing application and the hardware device, wherein the predetermined workflow associates predefined data property identifiers to different types of data items written to the nonvolatile memory device by the executing application or the hardware device; comparing, by the software component, activities of the at least one executing application and the hardware device to the predetermined workflow; and using the predetermined workflow to automatically assign the data property identifiers to the data items used by the application or the hardware device, such that the data items and assigned data property identifiers are transmitted over a channel to the nonvolatile memory device for storage wherein the nonvolatile memory device reads the data property identifiers and identifies which blocks of the nonvolatile memory device to store the corresponding data items, such that the data items having the same data property identifiers are stored in a same block.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of provisional Patent Application Ser. No. 62/192,045, filed Jul. 13, 2015, and provisional Patent Application Ser. No. 62/245,100, filed Oct. 22, 2015, both incorporated herein by reference.

BACKGROUND

Flash memory based solid-state drives (SSD) have been used widely in both consumer computers and enterprise servers. There are two main types of flash memory, which are named after the NAND and NOR logic gates. NAND type flash memory may be written and read in blocks, each of which comprises a number of pages.

Since the NAND flash storage cells in SSDs have very unique properties, SSD's normal usages are very inefficient. For example, although it can be randomly read or programmed a page at a time, NAND flash memory can only be erased a block at a time. To rewrite a single NAND Flash page, the whole erase block (which contains a lot of flash pages) has to be erased first.

Since NAND flash based storage devices (e.g., SSDs) do not allow in-place updating, a garbage collection operation is performed when the available free block count reaches a certain threshold in order to prepare space for subsequent writes. The garbage collection includes reading valid data from the target erase block and writing the valid data to another block, while invalid data is not transferred to a new block. It takes a relatively significant amount of time to erase a NAND erase block, and each erase block has a limited number of erase cycles (from about 3K times to 10K times). Thus, garbage collection overhead is one of the biggest speed limiters in the technology class, incurring higher data I/O latency and lower I/O performance.

Therefore, operating systems (OS) and applications, which don't treat hot/cold data differently, and store them together, will see performance degradation over time (compared to OS's and applications that do treat hot and cold data differently), as well as a shorter SSD lifetime as more erase cycles are needed, causing the NAND cells to wear out faster.

SSD vendors and storage technical committees have come up with a new SSD and standard, called “multi-stream,” which allows hosts to group data together in save classes called streams. Each stream is saved independently by the SSD. Data in streams can theoretically be grouped together for any reason, one such reason is for the purpose of storing similar lifetime data together in order to reduce garbage collection issues.

However, to utilize this new interface, many changes within the applications (including source code) and the OS are required. As a typical computer can have tens or hundreds of software applications installed and running, it's very difficult for all applications, especially for legacy and closed-source applications, to adapt to those changes, in order to use SSDs more efficiently. In addition, multi-stream SSD has limited applicability in that multi-stream SSD is only compatible for use by operating systems and applications that now how to use it.

What is needed is an improved data property based data placement in a storage device, and more particularly, to an autonomous process that enables computer devices to utilize data property based data placement (e.g., multi-stream) solid-state drives.

BRIEF SUMMARY

The example embodiments provide methods and systems for data property-based data placement inside a nonvolatile memory device performed by a storage controller of the nonvolatile memory device. In one aspect, the embodiments include: executing a software component on the computer device that detects at least one of an executing application and a hardware device connecting to the computing device; responsive to detecting the at least one executing application and the hardware device, searching, by the software component, a workflow repository to find a predetermined workflow associated with the at least one executing application and the hardware device, wherein the predetermined workflow associates predefined data property identifiers to different types of data items written to the nonvolatile memory device by the executing application or the hardware device; comparing, by the software component, activities of the at least one executing application and the hardware device to the predetermined workflow; and using the predetermined workflow to automatically assign the data property identifiers to the data items used by the application or the hardware device, such that the data items and assigned data property identifiers are transmitted over a channel to the nonvolatile memory device for storage wherein the nonvolatile memory device reads the data property identifiers and identifies which blocks of the nonvolatile memory device to store the corresponding data items, such that the data items having the same data property identifiers are stored in a same block.

The example embodiments also include a system, comprising: a nonvolatile memory device; and a computer device coupled to the nonvolatile memory device. The computer device executes a software component serving as an interface for enabling the computer device to utilize data property-based data placement inside the nonvolatile memory device. The software component is configured to: detect at least one of an executing application and a hardware device connecting to the computing device; responsive to detecting the at least one executing application and the hardware device, search a workflow repository to find a predetermined workflow associated with the at least one executing application and the hardware device, wherein the predetermined workflow associates predefined data property identifiers to different types of data items written to the nonvolatile memory device by the executing application or the hardware device; compare activities of the at least one executing application and the hardware device to the predetermined workflow; and use the predetermined workflow to automatically assign the data property identifiers to the data items used by the application or the hardware device, such that the data items and assigned data property identifiers are transmitted over a channel to the nonvolatile memory device for storage wherein the nonvolatile memory device reads the data property identifiers and identifies which blocks of the nonvolatile memory device to store the corresponding data items, such that the data items having the same data property identifiers are stored in a same block.

The example embodiments further include a nonvolatile memory device, comprising: a memory array; and a storage controller coupled to the memory array and to a memory channel. The storage controller is configured to: receive over the memory channel from at least one of an operating system and an executing application, a first series of data items to be stored, wherein each of the data items includes a first data property identifier that is associated with the data items based on the one or more data properties indicating data similarity, including the data lifetime, the data type, and the physical data source; receive over the memory channel from a hardware device controller a second series of data items to be stored, wherein each of the second series of data items includes a second data property identifier that is associated with the second series of data items based on one or more data properties indicating data similarity, including a data lifetime, a data type, and a physical data source; read the data property identifiers and identifying which blocks of the nonvolatile memory to store the corresponding first and second series of data items, such that the data items having the same data property identifiers are stored in a same block; and storing the data items into the identified blocks.

The example embodiments also include a method for data property-based data placement inside a nonvolatile memory device performed by a storage controller of the nonvolatile memory device. The program instructions include: receiving over a memory channel from at least one of an operating system and an executing application, a first series of data items to be stored, wherein each of the data items includes a first data property identifier that is associated with the data items based on the one or more data properties indicating data similarity, including a data lifetime, a data type, data size, logical block address (LBA) ranges, LBA access patterns, and a physical data source; receiving over the memory channel from a hardware device controller a second series of data items to be stored, wherein each of the second series of data items includes a second data property identifier that is associated with the second series of data items based on one or more data properties indicating data similarity, including a data lifetime, a data type, data size, logical block address (LBA) ranges, LBA access patterns, and a physical data source; reading the data property identifiers and identifying which blocks of the nonvolatile memory device to store the corresponding first and second series of data items, such that the data items having the same data property identifiers are stored in a same block; and storing the data items into the identified blocks.

The example embodiments may further include a method for data property-based data placement inside a nonvolatile memory device performed by a storage controller of the nonvolatile memory device. In one aspect, the embodiments may include executing a software component on the computer; querying, by the software component, a workflow repository to find a predetermined workflow associated with the software component, wherein the predetermined workflow associates predefined data property identifiers to different types of data items to be written to the nonvolatile memory device; during operation of the software component, sending one or more requests to the predetermined workflow for one or more data property identifiers to associate with data items used by the software component; and responsive to the software component receiving the one or more data property identifiers from the predetermined workflow, automatically assigning the data property identifiers to the data items used by the software component and transmitting the data items and assigned data property identifiers to the nonvolatile memory device for storage, wherein the nonvolatile memory device reads the data property identifiers and identifies which blocks of the nonvolatile memory device to store the corresponding data items, such that the data items having the same data property identifiers are stored in a same block.

BRIEF DESCRIPTION OF SEVERAL VIEWS OF THE DRAWINGS

These and/or other features and utilities of the present general inventive concept will become apparent and more readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

FIG. 1 is a block diagram illustrating an example embodiment of a system for data property-based data placement in a nonvolatile memory device provided by a workflow monitor interface;

FIG. 2 is a flow diagram illustrating the process performed on the host system for providing a workflow monitor interface for enabling a computer device to utilize data property-based data placement inside a nonvolatile memory device according to one example embodiment;

FIG. 3 is a diagram illustrating the workflow monitor interface of the example embodiments implemented in various types of computing devices, thereby making the computer devices compatible with an SSD having data property-based data placement;

FIG. 4 is a flow diagram illustrating a process for data property-based data placement performed by the storage controller of the nonvolatile memory device according to an example embodiment;

FIG. 5 is a block diagram illustrating an example of the operation of the workflow monitor interface with respect to storage operations performed by a database application that stores data having different lifetimes and different properties; and

FIG. 6 is a block diagram illustrating the workflow monitor interface in further detail.

FIG. 7 is a block diagram illustrating another embodiment of a data identifier assignment method.

DETAILED DESCRIPTION

Reference will now be made in detail to the embodiments of the present general inventive concept, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. The embodiments are described below in order to explain the present general inventive concept while referring to the figures.

Advantages and features of the present invention and methods of accomplishing the same may be understood more readily by reference to the following detailed description of embodiments and the accompanying drawings. The present general inventive concept may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concept of the general inventive concept to those skilled in the art, and the present general inventive concept will only be defined by the appended claims. In the drawings, the thickness of layers and regions are exaggerated for clarity.

The use of the terms “a” and “an” and “the” and similar referents in the context of describing the invention (especially in the context of the following claims) are to be construed to cover both the singular and the plural, unless otherwise indicated herein or clearly contradicted by context. The terms “comprising,” “having,” “including,” and “containing” are to be construed as open-ended terms (i.e., meaning “including, but not limited to,”) unless otherwise noted.

The term “algorithm” or “module”, as used herein, means, but is not limited to, a software or hardware component, such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC), which performs certain tasks. An algorithm or module may advantageously be configured to reside in the addressable storage medium and configured to execute on one or more processors. Thus, an algorithm or module may include, by way of example, components, such as software components, object-oriented software components, class components and task components, processes, functions, attributes, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables. The functionality provided for the components and components or modules may be combined into fewer components or modules or further separated into additional components and components or modules.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It is noted that the use of any and all examples, or exemplary terms provided herein is intended merely to better illuminate the invention and is not a limitation on the scope of the invention unless otherwise specified. Further, unless defined otherwise, all terms defined in generally used dictionaries may not be overly interpreted.

In one aspect, the example embodiments provide an interface for enabling a computer device to utilize data property-based data placement (e.g., multi-streaming) inside a nonvolatile memory device, even for applications and devices not programmed to utilize muti-streaming. In particular, the example embodiments provide an application model-based stream identification process that monitors activity of the computer device and uses the knowledge of an executing application's or connected device's workflow to assign pre-determined data property identifiers to data items saved to a nonvolatile memory device. Consistent with multi-streaming, the receiving memory device can assume that all data with the same data property identifier data will be invalidated at (approximately) the same time, and place such data into common erase blocks.

FIG. 1 is a block diagram illustrating an example embodiment of a system for data property-based data placement in a nonvolatile memory device provided by a workflow monitor interface. The example embodiments described herein may be applicable to any nonvolatile memory device requiring garbage collection, and will be explained with respect to an embodiment where the nonvolatile memory device comprises a solid-state drive (SSD).

The system includes a host system 10 coupled to an SSD 12 over a channel 14. As used herein, a channel refers to any physical interface that connects to nonvolatile memory (NVM) devices (e.g., SSD) to a computer or any other hardware that uses the SSD. The interface may include wired interfaces, such as SATA, SCSI, PCIe, USB, iSCSI, FC, and Ethernet, and wireless interfaces such as Wi-Fi. As is well-known, an SSD has no moving parts to store data and does not require constant power to retain that data. Components of the host system 10 that are relevant to this disclosure include a processor 16, which executes computer instructions from a memory 18 including, an operating system (OS) 20 and a file system 21. The host system 10 may include other components (not shown), such as a memory controller for interfacing with the channel 14. The host system 10 and the SSD 12 communicate commands and data items 26 over the channel 14. In one embodiment, the host system may be a typical computer or server running any type of OS. Example types of OSs include single- and multi-user, distributed, templated, embedded, real-time, and library. In another embodiment, the system may be a standalone component, such as a device controller, in which case the OS may comprise a lightweight OS (or parts thereof) or even firmware.

The SSD 12 includes a storage controller 22 and a nonvolatile memory (NVM) NVM array 24 to store data from the host system 10. The storage controller 22 manages the data stored in the NVM array 24 and communicates with the host system over the channel 14 via communication protocols. The NVM array 24 may comprise any type of non-volatile random-access memory (NVRAM) including flash memory, ferroelectric RAM (F-RAM), magnetoresistive RAM (MRAM), phase-change memory (PCM), millipede memory, and the like. Both the SSD 12 and channel 14 may support multi-channel memory architectures, such as dual channel architecture; and may also support single, double or quad rate data transfers.

According to the example embodiments, in order to reduce garbage collection overhead in the SSD 12, the example embodiments provide an improved data property-based data placement in the SSD. This is accomplished by providing a workflow monitor interface 26 that enables both applications and hardware components to separately store data items in the SSD 12 that have different lifespans. In addition, use of a workflow monitor interface 26 requires no changes to user applications running on the host system 10.

In one embodiment, the workflow monitor interface 26 comprises at least one software component executed by the processor 16 that continuously monitors the host system 10 for executing applications and/or connected hardware devices. The workflow monitor interface 26 has knowledge of predetermined workflow patterns for the applications and connected devices, and assigns data property identifiers (e.g., stream IDs) to data items written by the applications and the devices based on those workflow patterns.

According to one aspect of example embodiments, the workflow monitor interface 26 may include a workflow repository 27 that acts as a library of known workflows for various applications and devices. Each of the workflows in the workflow repository 27 may have associated with it one or more streams (i.e., one or more individual data writes) produced during various stages of the workflow with a given property identifier (e.g., a stream ID). In one embodiment, the workflow repository 27 is a component separate from the workflow monitor interface 26. However, in an alternative embodiment, the workflow repository 27 may be integrated with the workflow monitor interface 26. In one embodiment, the actual assignment of the data property identifiers 30 may be performed by software hooks in the file system 21 of the OS 20.

FIG. 2 is a flow diagram illustrating the process performed on the host system for providing a workflow monitor interface for enabling a computer device to utilize data property-based data placement inside the nonvolatile memory device according to one example embodiment. The process may include executing a software component (e.g., the workflow monitor interface 26) on the computer device that detects at least one of an executing application and a hardware device connecting to the computing device (block 200). In one embodiment, detecting executing applications may include detecting processes and/or threads. An example of a hardware device connection may include a camera that connects and communicates to the host device 10.

In one embodiment, detecting an executing application and/or a hardware device may be referred to collectively as detecting new data placement clients, which the software component then provides with data property-based data placement (e.g., multi-streaming capability) even though the application or the hardware device were not designed with such compatibility.

Responsive to detecting the executing application and/or the hardware device connecting, the software component searches the workflow repository to find a predetermined workflow associated with the executing application and/or the hardware device, wherein the predetermined workflow associates data property identifiers to different types of data items written to the nonvolatile memory device by the executing application and/or the hardware device (block 202).

In one embodiment, the workflow repository may be integrated with the workflow monitor interface 26 or be implemented as a separate component. In one embodiment the workflow repository 27 may be located within the computing device, while in another embodiment, the workflow repository may be located remote from the computing device. In either case, in one embodiment the workflow monitor interface 26 can receive new and updated workflows for the workflow repository to accommodate new applications and hardware devices.

The software component compares activities of the executing application and/or the hardware device to the predetermined workflow (block 204). In one embodiment, comparing the activities may include examining one or more current processes or steps performed by the application and/or the hardware device and matching the current processes or steps with a similar sequence of processes or steps in the predetermined workflow. As described above, the workflow associates one or more individual data writes performed during a sequence of processes or steps during various stages of the workflow with a given data property identifier.

The software component uses the predetermined workflow to automatically assign the data property identifiers to the data items used by the executing application and/or the hardware device, such that the data items and assigned data property identifiers are transmitted to the nonvolatile memory device for storage (block 206).

According to one embodiment, the workflow monitor interface 26 uses the workflow repository 27 to associate or assign the data property identifiers 30 to each of the data items 28 based on one or more data properties indicating data similarity, such as a data lifetime, a data type, data size, and a physical or logical data source. In this manner, data items 28 having the same or similar data properties are assigned the same data property identifier value.

Because the workflow monitor interface 26 is provided at the operating system level in one embodiment, no changes are required to existing applications in order to make those applications compatible with the data property-based data placement process of the example embodiment. Accordingly, the workflow monitor interface 26 may be implemented in any type of computing device having a processor and operating system to expand use of conventional multi-streaming beyond applications and operating systems.

FIG. 3 is a diagram illustrating the workflow monitor interface of the example embodiments implemented in various types of computing devices 300A-300D, thereby making the computer devices compatible with an SSD 12 having data property-based data placement (e.g., multi-streaming).

Computing devices

300A and 300B may represent host devices such as a PC or server or storage subsystem in which respective

workflow monitor interfaces

26A and 26B are provided within operating systems 20A and 20B or optionally as a standalone application. The workflow monitor interface 26A monitors data item operations performed by an application 304A, and automatically assigns data property identifiers 30A to each of the data items from application 304A based on a matching workflow from the workflow repository. Similarly, the workflow monitor interface 26B monitors data item operations performed by a block layer 23B of the OS 20B, and automatically assigns data property identifiers 30B to each of the data items operated on by the block layer 23B based on a matching workflow from the workflow repository.

Computing devices

300C and 300D may represent any type of hardware device that utilizes a nonvolatile memory device, including a camera, a microphone, a thermometer, a GPS, a clock, a sensor, a switch, a router, a RAID system, or a host bus adapter (HBA) system. For certain types of hardware devices, the workflow monitor interfaces 26C may be provided within a hardware device controller 306C. The workflow monitor interface 26C automatically assigns data property identifiers 30C to data item operations (e.g. a write) from the device controller 306C based on a known workflow. For other types of devices 300D, such as a camera, the workflow monitor interface 26D may be implemented as part of the OS or run as a separate application on a processor. The workflow monitor interface 26D monitors data item operations performed by a processor 306D, and automatically assigns data property identifiers 30D to each of the data items from the processor 306D based on a known or matching workflow from the workflow repository.

FIG. 4 is a flow diagram illustrating a process for data property-based data placement performed by the storage controller of the nonvolatile memory device according to an example embodiment. Referring to both FIGS. 3 and 4, the process may include receiving over a channel from at least one of an operating system or an executing application (e.g., OS 20B or apps 304A), a first series of data items to be stored, wherein each of the data items includes a first data property identifier that is associated with the data items based on the one or more data properties indicating data similarity, which may include a data lifetime, a data type, data size, logical block address (LBA) ranges, LBA access patterns, and a physical data source (block 400). It should be noted that many types of data properties such as data lifetime, a data type, data size, logical block address (LBA) ranges, LBA access patterns, and a physical data source may be considered for assessing similarity, including data properties not listed here or which are currently not known.

In one embodiment, the data type may include properties outside of the application of origin. In one embodiment, the data items received from the operating system or the application may include data property identifiers that are associated with the data items by another process besides the workflow monitor interface 26.

The storage controller receives over the channel from a hardware device (e.g., controller 306C or processor 306D) another series of data items to be stored, wherein each of the data items includes a second data property identifier that is associated with the data items based on one or more of the data properties indicating data similarity, (block 402).

The storage controller reads the data property identifiers and identifies which blocks of the memory device to store the corresponding data items, such that the data items having the same data property identifiers are stored in a same set of blocks (block 404), and stores the data items into the identified blocks (block 406).

For example, with respect to FIG. 3, the storage controller 22 of the SSD 12 receives the data items from the

computing devices

300A and 300B that have been assigned

data property ID

30A and 30B, respectively. The storage controller 22 then stores data items associated with data property ID 30A within the same erase block(s) 308A, and stores data items associated with data property ID 30B within the same erase block(s) 308B. Similarly, the storage controller 22 of the SSD 12 receives the data items from the

device controllers

306C and 306D of computing

devices

300C and 300D that have been assigned

data property ID

30C and 30D, respectively. The storage controller 22 then stores data items associated with data property ID 30C within the same erase block(s) 308C, and stores data items associated with data property ID 30D within the same erase block(s) 308D. Note, in one embodiment erase

blocks

308C and 308D need not be mutually exclusive sets of blocks, if the data identifiers indicate that the data between sources is actually similar.

According to the workflow monitor interface 26 of some example embodiments, a data property ID 30 may be assigned to the data items 28 that are output from any type input device for storage. For example, assume the workflow monitor interface 26 is implemented within a digital security camera that takes an image periodically, e.g., once a second. The workflow monitor interface 26 may assign a data property ID 30 to each image file based on data properties indicating data similarity, such as the capture rate of the images, the image file size, and the origin of the images (e.g., device ID and/or GPS location). Note that such data properties need not be associated with a particular application or file system as is the metadata used by conventional multi-streaming.

As a further example, FIG. 5 is a block diagram illustrating an example of the operation of the workflow monitor interface 26 with respect to storage operations performed by a database application that stores data having different lifetimes and different properties. In one embodiment, the database may refer to RocksDB™, which is an embeddable persistent key-value store for fast storage. RocksDB is a fork of LeveIDB™ which has been optimized to take advantage of many CPU cores and make efficient use of fast storage, such as solid-state drives (SSD), for IO bound workloads. In operation, a data file (e.g., a SST file) with a sorted set of key-value pairs is written sequentially to a first-level file. During a write operation, instead of modifying the files, changes are collected in memory for a time, and then written as a second-level file with the changes. For more changes, yet another level can be added.

When the workflow monitor interface 26 detects that the RocksDB has started-up, the workflow monitor interface 26 may retrieve and use a RocksDB workflow 27′ associated with the RocksDB application to assign distinct data property identifiers to data manipulated by the RocksDB. The RocksDB workflow 27′ may comprise a tree workflow, such as an LSM Tree workflow. The RocksDB is one example implementation of an LSM Tree workflow; others may include BigTable, Apache HBase, LevelDB, WiredTiger, Apache Cassandra, Riak, SQLite4, and Cockroachdb.

The database 500 and the workflow monitor interface 26 and the RocksDB workflow 27′ are shown in memory 18 of the host system. The database 500 makes use of a memtable 502 stored in memory 18. Within the SSD 12, the database 500 makes use of a write ahead log 504 and various SST files 506 (e.g., SST file 1, SST file 2 . . . SST file n) stored on different levels (e.g., level 0, level 1 . . . level m).

When the database 500 performs a write operation 510, the database stores the data in a structure in the memtable 502, and also appends the write to the write-ahead log 504. The write ahead log 504 receives every write, which survives permanently even after power failure. The workflow monitor interface 26 monitors the write operation 510 and may assign data property identifier #1 to the log files based on the RocksDB workflow 27′.

The memtable 502 stores writes until the contents of the memtable 502 reach a configurable threshold, at which point a flush operation 512 is performed to flush the writes to an SST file 506 in the SSD 12. Data in the write ahead log 504 may be purged after the corresponding data in the memtable 502 is flushed to an SST file 506. SST files 506 are typically not written to again after the memtable 502 is flushed. The workflow monitor interface 26 monitors the flush operation 512 and may assign data property identifier #2 to the level 0 SST files 506 based on the RocksDB workflow 27′.

As inserts/updates occur, instead of overwriting the rows, the database 500 may write a new timestamped version of the inserted or updated data in another SST file 506. The database 500 manages the accumulation of SST files 506 on the SSD 12 using compaction. Once the data stored at level 0 reaches a data threshold, the database 500 performs a compaction operation 514 to compress the database file by removing deleted data, columns, and rows, created during updates, and consolidating the valid data from the level 0 the SST files into new SST files stored on level 1. The database 500 uses the new consolidated SST files instead of multiple old SST files, enabling read request to be fulfilled more efficiently than before compaction. The old SST files are deleted as soon as any pending reads finish using the files. The workflow monitor interface 26 monitors the compaction operation 514 and may assign data property identifier #3 to the level 1 SST files 506 based on the RocksDB workflow 27′.

Once the data stored at level 1 reaches a data threshold, the database 500 performs a compaction operation 516 that removes unused data and consolidates the valid data from the level 1 SST files into new SST files stored on level 2. The workflow monitor interface 26 monitors the compaction operation 516 and may assign data property identifier #4 to the level 2 SST files 506 based on the RocksDB workflow 27′, and so on. This example illustrates that according to the present invention, one application can have multiple streams for a single type of file.

According to an example embodiment, data property identifiers are assigned to the data based on expected lifetimes groupings (in this case, to SST levels) and the data may be stored in the SSD based on these expected lifetimes. It is unknown when the data will be invalidated or deleted, but the workflow monitor interface 26 assumes that the data having the same data property identifiers will be invalidated at or around the same time.

FIG. 6 is a block diagram illustrating the workflow monitor interface, which is one example of identifier assignment method, in further detail. Similar to FIGS. 1 and 3, the workflow monitor interface 26 is shown provided at the operating system 20 level of the host system 10. The workflow monitor interface 26 monitors the operations of the applications 300, the file system 21, and block layer 23, device drivers, and connected devices and assigns data property identifiers 30 to data items based on the corresponding workflow 27′. The SSD 12 reads the data property identifiers 30 and identifies which blocks of the SSD 12 are used to store the corresponding data items so that the data items having the same data property identifiers 30 are stored in a same block.

According to some example embodiments, the workflow monitor interface 26 may continuously run in the background to monitor the start-up of applications 300 and connected devices 302. In one embodiment, the workflow monitor interface 26 may maintain a database (not shown) of data item modifications to the SSD 12. The workflow monitor interface 26 may monitor file update operations performed by an applications/device and automatically assign a data property ID 30 to each of the file update operations according to the workflow 27′.

The workflow monitor interface 26 may include a component that utilizes system call hooks at the file system level to monitor file update operations (create/write/update/delete) made to the files by the applications 300, the OS 20, and/or the connected device 302. Most operating systems, such as Windows and Linux, provide file system hooks for system programming purposes. The workflow monitor interface 26 may look up the file update operation (or a sequence of such operations) in the workflow 27′ to find the predetermined data property ID assigned to that operation.

The workflow monitor interface 26 may then assign the predetermined data property identifier 30 to the update operation. In on embodiment, the workflow 27′ may assign file creations or fresh file writes data property IDs 30 according to the file's type or any other characteristic of the data. Finally, the workflow monitor interface 26 may forward the actual file writes to the underlying file system 21.

As an example of the data property ID assignments, assume the following: a user is editing a photo app to edit a photo file named foo.jpg (a JPEG file type); and the SSD of the user's computer is configured to handle up to four data property IDs or stream IDs. When the user saves the photo onto the SSD 12, the workflow monitor interface 26 monitors and looks up the file save request in the workflow 27′ associated with the photo app. The workflow 27′ specifies which of the four data property IDs should be assigned to the save request, e.g. a “1”.

The workflow monitor interface 26 assigns the data property ID of 1 as specified in the workflow and that data property ID is then sent with the file data through the file system 21 and block layer 23 to the SSD 12 for storage in a block that stores other data having an assigned data property ID of 1.

In an alternative embodiment, the workflow monitor interface 26 and workflow repository 27′ may be implemented within the OS block storage layer 23 or even inside the SSD 12.

FIG. 7 is a block diagram illustrating another embodiment of a data identifier assignment method. Instead of providing a separate workflow monitor interface 26 (FIG. 6) that assigns data property identifiers, the present embodiment makes the workflow repository 27 storing known workflows and data placement settings directly assessable to executing software components, such as applications 300, various layers of operating system 20 (e.g., file system 21, block layer 25 and device drivers 29), and software embedded in connected devices 302. The workflow repository 31 may store one or more predetermined workflows 33 that associate predefined data property identifiers to different types of data items to be written to the nonvolatile memory device during activities/functions performed by the software components.

The various software components can themselves query the workflow repository 31 and obtain information on what data property IDs 30 to use. Thus, for example, a software component may 1) identify itself to the workflow repository 31, 2) obtain data property 30 IDs to use for various functions, and 3) assign the data property IDs 30 to data items.

In contrast to the workflow monitor embodiment that monitors existing component operations and automatically applies the data property IDs, the present embodiment relies on a request/response mechanism with the workflow repository 31 so that the already existing components can add multi-streaming capability. The workflow monitor embodiment requires very little reprogramming of existing software components, but does require additional work to be done in creating and running the workflow monitor software. The present embodiment requires slight reprogramming of existing software components, but dispenses with the need to create, run, and maintain a workflow monitor.

In further detail of the present embodiment, a software component may query the workflow repository 31 itself to find a predetermined workflow 33 associated with the software component. In one embodiment, the query may include an identification of the software component. The response from the workflow repository 31 may include the identity of the workflow 33 assigned to the software component.

During operation, the software component may send one or more requests to the identified workflow 33 for one or more data property identifiers to associate with data items used by the software component. In one embodiment, the request may include a current operation to be performed by the software component and one or more attributes of the current operation which will be performed (e.g. data type). In one embodiment, the software component may make query identifying the software component to the workflow repository 31 using an identifier (e.g., name or some form of ID) of the software component, followed by a second query for data property identifiers associated with the software component from the identified workflow 33. In another embodiment, the software component may make a single query that includes the identity of the software component along with the request for the data property identifiers.

Rather than query workflow repository 31 using a name or ID as would an application, in the embodiment where the software component comprises an operating system (OS), each level of the operating system could provide input to the workflow repository 31 that is relevant to the corresponding operating system level in order to obtain one or more data property identifiers. For example, at the file system level, the OS could use a file type, size, etc. when querying for data property identifiers. At the block level, the OS could use LBA ranges and the like. In further embodiment, the OS could use device IDs from attached devices to obtain data property identifiers from the workflow repository 31.

In response to a query from the software component, the workflow 33 returns to the software component one or more data property IDs as specified in the workflow 33 for that operation and the type of data item.

Responsive to receiving the data property IDs from the workflow 33, the software component may automatically assign the data property IDs to the data items used by the software component, and transmit the data items and assigned data property identifiers to the nonvolatile memory device (e.g. SSD 12) for storage.

The SSD 12 reads the data property IDs 30 and identifies which blocks of the SSD 12 are used to store the corresponding data items so that the data items having the same data property IDs 30 are stored in a same block.

As an example of the data property ID assignments, assume the following: a user is editing a photo app to edit a photo file named foo.jpg (a JPEG file type); and the SSD of the user's computer is configured to handle up to four data property IDs or stream IDs. When the user saves the photo onto the SSD 12, the photo app may send a request to the workflow 27′ associated with the photo app for the data property ID assigned to a file save operation. The workflow 27′ specifies which of the four data property IDs should be assigned to the save operation, e.g. a “1”.

The photo app assigns the data property ID of 1 as specified in the workflow and that data property ID is then sent with the file data through the file system 21 and block layer 23 to the SSD 12 for storage in a block that stores other data having an assigned data property ID of 1.

In one embodiment, the workflow repository 31 may be implemented as a database application.

In one embodiment, the workflow monitor interface 26 is implemented as a software component. In another embodiment, the workflow monitor interface 26 could be implemented as a combination of hardware and software. Although the workflow monitor interface 26 is shown as a single component, the functionality of the workflow monitor interface 26 may be implemented using a greater number of modules/components.

The workflow monitor interface 26 of the example embodiments may be applied to a broad range of storage markets from client to enterprise, which could be applied to a disk for a single standalone machine (such as desktop, laptop, workstation, server, and the like), storage array, software-define storage (SDS), application-specific storage, virtual machine (VM), virtual desktop infrastructure (VDI), content distribution network (CDN), and the like.

In one embodiment, for example, the NVM array 24 of the SSD 12 may be formed of a plurality of non-volatile memory chips, i.e., a plurality of flash memories. As another example, the NVM array 24 may be formed of different-type non-volatile memory chips (e.g., PRAM, FRAM, MRAM, etc.) instead of flash memory chips. Alternatively, the NVM array 24 can be formed of volatile memories, i.e., DRAM or SRAM, and may have a hybrid type where two or more types of memories are mixed.

A methods and systems for data property-based data placement in a storage device, and a workflow monitor interface for enabling computer systems to utilize the data placement method has been disclosed. The present invention has been described in accordance with the embodiments shown, and there could be variations to the embodiments, and any variations would be within the spirit and scope of the present invention. For example, the exemplary embodiment can be implemented using hardware, software, a computer readable medium containing program instructions, or a combination thereof. Software written according to the present invention is to be either stored in some form of computer-readable medium such as a memory, a hard disk, or a CD/DVD-ROM and is to be executed by a processor. Accordingly, many modifications may be made by one of ordinary skill in the art without departing from the spirit and scope of the appended claims.

Claims

We claim:

1. A method for providing an interface for enabling a computer device to utilize data property-based data placement inside a nonvolatile memory device, the method comprising:

executing a software component on the computer device that detects at least one of an executing application and a hardware device connecting to the computer device;

responsive to detecting the at least one of the executing application and the hardware device, searching, by the software component, a workflow repository to find a predetermined workflow associated with the at least one of the executing application and the hardware device, wherein the predetermined workflow associates predefined data property identifiers to different types of data items written to the nonvolatile memory device by the at least one of the executing application and the hardware device, the predetermined workflow including at least one of a known pattern of processes and a known pattern of steps performed by the at least one of the executing application and the hardware device, the pattern of known processes includes different processes and the pattern of known steps includes different steps, the different processes and the different steps including a plurality of data item update operations for the nonvolatile memory device;

comparing, by the software component, activities of the at least one of the executing application and the hardware device to the predetermined workflow; and

using the predetermined workflow to automatically assign the data property identifiers to the data items used by the at least one of the executing application and the hardware device, such that the data items and assigned data property identifiers are transmitted over a channel to the nonvolatile memory device for storage, wherein the nonvolatile memory device reads the data property identifiers and identifies which blocks of the nonvolatile memory device to store the corresponding data items, such that the data items having the same data property identifiers are stored in a same block.

2. The method of claim 1, wherein the hardware device comprises at least one of: a camera, a microphone, a thermometer, a GPS, a clock, a sensor, a switch, a router, a RAID system, or a host bus adapter (HBA) system.

3. The method of claim 1, wherein detecting the at least one of the executing application and the hardware device comprises detecting new data placement clients, which the software component then provides with data property-based data placement even though the at least one of the executing application and the hardware device were not designed with such capability.

4. The method of claim 1, wherein the software component comprises a workflow monitor interface for enabling the computer device to utilize data property-based data placement of the nonvolatile memory device.

5. The method of claim 4, further comprising: the workflow monitor interface receiving new and updated workflows for the workflow repository to accommodate new applications and hardware devices.

6. The method of claim 5, wherein comparing activities of the at least one of the executing application and the hardware device to the predetermined workflow is performed by:

examining one or more current processes or steps performed by the at least one of an application and a hardware device and matching the current processes or steps with at least a portion of the known pattern of processes or steps in the predetermined workflow.

7. A system, comprising:a nonvolatile memory device; and

a computer device coupled to the nonvolatile memory device, the computer device executing a software component serving as an interface for enabling the computer device to utilize data property-based data placement inside the nonvolatile memory device, the software component configured to:

detect at least one of an executing application and a hardware device connecting to the computer device;

responsive to detecting the at least one of the executing application and the hardware device, search a workflow repository to find a predetermined workflow associated with the at least one of the executing application and the hardware device, wherein the predetermined workflow associates predefined data property identifiers to different types of data items written to the nonvolatile memory device by the at least one of the executing application and the hardware device, the predetermined workflow including at least one of a known pattern of processes and a known pattern of steps performed by the at least one of the executing application and the hardware device, the known pattern of processes including different processes and the known pattern of steps including different steps, the different processes and the different steps including a plurality of data item update operations for the nonvolatile memory device;

compare activities of the at least one of the executing application and the hardware device to the predetermined workflow; and

use the predetermined workflow to automatically assign the data property identifiers to the data items used by the at least one of the executing application and the hardware device, such that the data items and assigned data property identifiers are transmitted over a channel to the nonvolatile memory device for storage, wherein the nonvolatile memory device reads the data property identifiers and identifies which blocks of the nonvolatile memory device to store the corresponding data items, such that the data items having the same data property identifiers are stored in a same block.

8. The system of claim 7, wherein the hardware device comprises at least one of: a camera, a microphone, a thermometer, a GPS, a clock a sensor, a switch, a router, a RAID system, or a host bus adapter (HBA) system.

9. The system of claim 7, wherein detection of the at least one of the executing application and the hardware device comprises detecting new data placement clients, which the software component then provides with data property-based data placement even though the at least one application and hardware device were not designed with such capability.

10. The system of claim 7, wherein the software component comprises a workflow monitor interface for enabling the computer device to utilize data property-based data placement of the nonvolatile memory device.

11. The system of claim 10, wherein a workflow monitor interface receives new and updated workflows for the workflow repository to accommodate new applications and hardware devices.

12. The system of claim 11, wherein the workflow monitor interface compares activities of the at least one of the executing application and the hardware device to the predetermined workflow by:

13. A nonvolatile memory device, comprising:a memory array; and

a storage controller coupled to the memory array and to a memory channel, the storage controller configured to:

receive over the memory channel from at least one of an operating system and an executing application, a first series of data items to be stored, wherein each of the data items includes a first data property identifier that is associated with the data items based on one or more data properties indicating data similarity based on a first predetermined workflow for the executing application, the first predetermined workflow including at least one of a first known pattern of processes and a first known pattern of steps performed by the executing application, the first known pattern of processes including different processes and the known pattern of steps including different steps, the different processes and the different steps including a plurality of data item update operations for the nonvolatile memory device;

receive over the memory channel from a hardware device controller a second series of data items to be stored, wherein each of the second series of data items includes a second data property identifier that is associated with the secondseries of data items based on the one or more data properties indicating data similarity, the data similarity being based on a second predetermined workflow for the hardware device, the second predetermined workflow including at least one of a second known pattern of processes and a second known pattern of steps performed by the hardware device;

read the data property identifiers and identifying which blocks of the nonvolatile memory device to store the corresponding first and second series of data items, such that the data items having the same data property identifiers are stored in a same block; and

store the data items into the identified blocks.

14. The nonvolatile memory device of claim 13, wherein the hardware device comprises at least one of: camera, a microphone, a thermometer, a GPS, a clock, a sensor, a switch, a router, a RAID system, or a host bus adapter (HBA) system.

15. The nonvolatile memory device of claim 13, wherein the at least one of the operating system and the executing application or the hardware device controller are part of a computer device.

16. The nonvolatile memory device of claim 15, wherein the computer device includes a workflow monitor interface for enabling the computer device to utilize data property- based data placement of the nonvolatile memory device.

17. The nonvolatile memory device of claim 16, wherein the workflow monitor interface executes at an operating system level in the computer device and is configured to:

detect at least one of the executing application and a hardware controller connecting to the computer device;

responsive to detecting the at least one of the executing application and the hardware controller, search a workflow repository to find a predetermined workflow associated with the at least one of the executing application and the hardware controller, the predetermined workflow including at least one of the first predetermined workflow and the second predetermined workflow, wherein the predetermined workflow associates predefined data property identifiers to different types of data items written to the nonvolatile memory device by the at least one of the executing application and the hardware controller;

use the predetermined workflow to automatically assign the data property identifiers to the data items used by the at least one of the executing application and the hardware device, such that the data items and assigned data property identifiers are transmitted over a channel to the nonvolatile memory device for storage.

18. A method for data property-based data placement inside a nonvolatile memory device performed by a storage controller of the nonvolatile memory device, the method comprising:

receiving over a memory channel from at least one of an operating system and an executing application, a first series of data items to be stored, wherein each of the data items includes a first data property identifier that is associated with the data items based on one or more data properties indicating data similarity based on a first predetermined workflow for the executing application, the first predetermined workflow including at least one of a first known pattern of processes and a first known pattern of steps performed by the executing application, the first known pattern of processes including different processes and the known pattern of steps including different steps, the different processes and the different steps including a plurality of data item update operations for the nonvolatile memory device;

receiving over the memory channel from a hardware device controller a second series of data items to be stored, wherein each of the second series of data items includes a second data property identifier that is associated with the second series of data items based on the one or more data properties indicating data similarity based on a second predetermined workflow for the hardware device, the second predetermined workflow including at least one of a second known pattern of processes and a second known pattern of steps performed by the hardware device;

reading the data property identifiers and identifying which blocks of the nonvolatile memory device to store the corresponding first and second series of data items, such that the data items having the same data property identifiers are stored in a same block; and

storing the data items into the identified blocks.

19. The method of claim 18, wherein the hardware device comprises at least one of: camera, a microphone, a thermometer, a GPS, a clock, a sensor, a switch, a router, a RAID system, or a host bus adapter (HBA) system.

20. The method of claim 18, wherein the at least one of the operating system and the executing application or the hardware device controller are part of a computer device.

21. The method of claim 20, wherein the computer device includes a workflow monitor interface for enabling the computer device to utilize data property-based data placement of the nonvolatile memory device.

22. The method of claim 21, wherein the workflow monitor interface executes at an operating system level in the computer device and is configured to:

use the predetermined workflow to automatically assign the data property identifiers to the data items used by the executing application or the hardware device, such that the data items and assigned data property identifiers are transmitted over a channel to the nonvolatile memory device for storage.

23. A method for providing an interface for enabling a computer device to utilize data property-based data placement inside a nonvolatile memory device, the method comprising:

executing a software component on the computer device;

querying, by the software component, a workflow repository to find a predetermined workflow associated with the software component, wherein the predetermined workflow associates predefined data property identifiers to different classes of data items to be written to the nonvolatile memory device, the predetermined workflow including at least one of a known pattern of processes and a known pattern of steps performed by the software component, the known pattern of processes including different processes and the known pattern of steps including different steps, the different processes and the different steps including a plurality of data item update operations for the nonvolatile memory device;

during operation of the software component, sending one or more requests to the workflow repository for one or more data property identifiers to associate with data items used by the software component; and

responsive to the software component receiving the one or more data property identifiers from the predetermined workflow, automatically assigning the data property identifiers to the data items used by the software component and transmitting the data items and assigned data property identifiers to the nonvolatile memory device for storage, wherein the nonvolatile memory device reads the data property identifiers and identifies which blocks of the nonvolatile memory device to store the corresponding data items, such that the data items having the same data property identifiers are stored in a same block.