CWIQ FS
Flexible file system with complete user access control.
A scalable, searchable, and secure data repository
CWIQ FS is a shared file system that scales automatically, with unlimited storage and high performance. This clustered file system provides a single global file system that is capable of spanning hundreds of machines, managing billions of files and petabytes of data. Delivering the full aggregate bandwidth of managed object stores like S3, metadata is updated in real-time across all machines to provide a consistent view of the firm data.
Data Storage:
Data is stored in a content-addressable convention to a key/value store such as S3 or disk-files. This allows for straightforward distribution and caching. Data can be located close to the client, with no danger of it being stale.
Massively Scalable:
By leveraging cloud infrastructure we can easily scale to petabytes & thousands of high-throughput nodes. File-Pattern Based ACLs: Limit users to particular date-ranges & datasets.
File-Pattern Based ACLs:
Limit users to particular date-ranges & datasets.
Data-Hiding:
Directories & files unreadable by the users do not show up in the directory listing.
Audit Logging:
For filesystem access (you can see what data are actually used, by who and how often)
Multi-Region/Cloud/Colo Deployment:
Multiple file storage backends, S3, GCS, Azure Storage, GPFS.
Deduplication:
Since we use content based hashing we automatically deduplicate files (massive savings on storage)
Plug & Play
CW CWIQ-FS runs on your existing on-prem or shared on-prem or public cloud
Access Auditing
Access to files and modifications are audited per user. Enhance your security with data hiding for directories and date range restrictions
Real Time
Including confirmation of point-in-time data delivery and data quality assurance
Powerful Algorithms
“Smart” content aware algorithms to ensure optimal storage performance
Each user has a unique view of shared directory contents.
- Users only see data that is provisioned for them
- Eases burden on administrators to protect intellectual property
- A shared data directory can contain many data-sets, users won’t know the full extent of which data set the company owns.
Use Case
The Problem
The Head of Data Strategy of a growing hedge fund requested the ability to allow permission to the Portfolio Teams to access specific data and not be able to see what the other teams are using or accessing. Their internal file system they were previously using was not capable of performing this task, so they started replicating the data and sending to the individual Teams, which was time consuming and costly, requiring them to store multiple copies of the same data.
The Challenge
Many firms have similar challenges which keeps the compliance team up at night with multiple copies of data being updated and delivered daily to multiple Teams or individual users. This is costly from both a compute and storage standpoint.
The Solution
CWIQ FS is a clustered file system that provides a single global file system that is global update capable to ensure data is updated across the firm. The file system is capable of spanning hundreds of machines, managing billions of files and petabytes of data. All while delivering the full aggregate bandwidth of managed object stores, such as S3. Metadata is updated in real-time across all machines so the cluster can see a consistent view of the world. CWIQ FS provides for data hiding and even date-range restrictions not only to the team level but also to the individual user level.
The Result
CWIQ FS not only met the requirement for data hiding as requested by the Head of Data Strategy, but it also reduced both compute and storage costs by close to 50%. The permission-able file system has achieved the original objective and is now being utilized to deliver out of sample data for internal users conducting research and evaluation of various data products, enhancing the funds data research process.
Get Started
View our full suite of products and start leveraging your data to its fullest potential.
