Frequently Asked Questions


Comparison with other Cloud Storage

How is ObjectiveFS different from Amazon EFS?

Accessiblity: ObjectiveFS is available in all regions and supports cross-region access. You can access your data from anywhere (ec2 in any region, servers from other cloud providers and on-prem servers). Amazon EFS is not available in all regions and can only be accessed by EC2 instances in the same region.

Performance: ObjectiveFS has high performance that scales. It is 100X faster than EFS for web servers, CMS and small file workloads compared to EFS (see details). For large files workloads such as videos, genomic data, ObjectiveFS has over 400MB/s throughput and can sustain high throughput 24x7 (see details). EFS performance is limited by burst limit based on the filesystem size (reference: Amazon EFS performance).

Features: ObjectiveFS has advanced features like automatic and checkpoint snapshots, multithreading, memory and disk cache, end-to-end encryption, etc. (See full feature list).

Storage Cost: ObjectiveFS doesn’t charge for storage, and you only pay the Amazon S3 storage cost (~$0.03/GB). Amazon EFS charges ~$0.30/GB.

Durability: ObjectiveFS uses highly durable object stores like Amazon S3 with 99.999999999% durability for storage. Amazon EFS is NFS-based.

Others: ObjectiveFS has been running in production since 2013. It also supports object stores such as Google Cloud Storage, Microsoft Azure, IBM COS, Oracle Cloud, etc.


How is ObjectiveFS different from S3FS?

ObjectiveFS is a POSIX-compatible file system that provides a standard file system interface. It is a log-structured filesystem on top of Amazon S3 that we implemented from scratch, and works with Linux and macOS programs and tools.

S3FS is a way of viewing your S3 bucket as a file system to make it easier to manage the objects in your bucket. While S3FS has a large subset of POSIX support, it is a one-to-one mapping, and doesn’t fully support regular file system semantics or consistency guarantees (e.g. atomic rename of directories, mutual exclusion of open exclusive, append to file requires rewriting the whole file and no hard links). This breaks the expectations of many Linux programs.

ObjectiveFS has built-in strong encryption and end-to-end data integrity check that are on by default.


How is ObjectiveFS different from S3QL?

ObjectiveFS supports concurrent mounts and read/write from multiple machines. S3QL supports only 1 node.

ObjectiveFS also keeps the file system data consistent and stores it in S3 as soon as possible, for sharing and to handle EC2 unexpected termination. S3QL uploads all metadata changes at a regular interval (by default every 24h) or during unmount.


How is ObjectiveFS different from GlusterFS and CephFS?

ObjectiveFS simplifies cluster management by offloading the storage cluster to the cloud providers. With GlusterFS and CephFS, you need to maintain your own storage cluster and need extra machines to store your data.


How is ObjectiveFS different from Box and Dropbox?

ObjectiveFS is a live filesystem, where any update is visible to all sharers. We also provide standard semantics (POSIX) to handle file operations and provide consistency guarantees. So, standard tools and software can run directly on it.

Box and Dropbox are file-sharing focused, and use the syncing filesystem approach. In a syncing filesystem, updates are synchronized in the background and potential conflicts may occur.


Pricing and Plans

How are “instances” counted?

We only count the number of active ObjectiveFS copies that you run concurrently. If you run two copies of ObjectiveFS at different times and they do not overlap, it is counted only as 1 instance.
Instances can be of the same or different file systems. For example, 3 servers all running the same file system, or each running a different file system both count as 3 instances.


What about usage spikes?

Only the 99-percentile of the max instances is counted. So short usage spikes (around 7 hours per month) are filtered out.


Are object store backend charges included?

Object store (e.g. AWS, GCS, Azure, etc) charges are billed separately by your object store provider, and are not included in our pricing.


Can I try it for free?

Yes. We have a 14-day free trial. No credit card is required. You can sign up here.


What is included in the 14-day free trial?

You get unlimited instances and support, so you can fully evaluate ObjectiveFS.


What if I decide to cancel?

If you no longer wish to use ObjectiveFS, you can cancel at any time.
You are never locked in to ObjectiveFS. You can always copy your data back to your local storage or other file systems using your favorite tools: tar, rsync, cp, pax, cpio, etc.


Can I get my data out from ObjectiveFS?

Yes, you can always copy your data back to your local storage or other file systems using standard tools (e.g. tar, rsync, etc).


What happens if you go out of business or discontinue ObjectiveFS?

Our company has been in business for over 20 years and we are in it for the long haul.
In the extremely unlikely event that we cease operation, all active users can continue using the software and keep accessing their data using ObjectiveFS.


Trial Users

Will I need to change to a new license if I subscribe after my trial is over?

No, your license will remain the same. When you subscribe to a plan, our system automatically upgrades your license. So, there is no need to change your setup and everything will continue to work.


Can I continue using the filesystems that I created during trial if I subscribe?

Yes, the filesystems that you created during your trial will continue to work. Uptime for our users is very important to us. So, everything you’ve set up during your trial will continue to work when you subscribe.


If I decide not to subscribe after the trial, will I lose my data?

Your data will be safely stored in your S3/GCS bucket. You can always copy your data back to your local storage or other file systems using regular tools (e.g. tar, rsync, cp, etc) from ObjectiveFS if you decide not to subscribe after the trial.

If you decide to use ObjectiveFS in the future, you can still access the data you have created during the trial if your S3/GCS bucket hasn’t changed.


S3 Buckets

ObjectiveFS is a log-structured filesystem and uses an S3 bucket as a storage backend. To provide POSIX compatibility and to make sure data is not corrupted during transit, all data and metadata are compressed, encrypted and checked by our end-to-end data integrity checker.

ObjectiveFS expects to manage all contents of the S3 bucket that it is using for storage, and to have only its files in that S3 bucket.


Can I use ObjectiveFS to access objects in non-ObjectiveFS S3 buckets?

No. ObjectiveFS is different from bucket viewers like S3FS and uses the S3 bucket as a storage backend (see description above for details).


Can I copy files directly into the S3 buckets and then read them with ObjectiveFS?

No. ObjectiveFS is a log-structured filesystem and uses S3 buckets as a storage backend (see details). So, copying files directly into the S3 bucket will not work with this design.


Can I store non-ObjectiveFS files in my ObjectiveFS S3 bucket?

No. Since ObjectiveFS is a log-structured filesystem, it expects to manage all contents of the bucket and to have only its files in the bucket. Please store non-ObjectiveFS files in a different S3 bucket.


Can I serve or view my files directly by looking at the objects in my ObjectiveFS S3 bucket?

No. ObjectiveFS uses S3 as a storage backend and implements a log-structured backend to provide features like snapshots. It also can store many small files in 1 object. Therefore, there is not a 1-to-1 mapping between a file and an S3 object in your S3 bucket.


How does ObjectiveFS protect my filesystem data during an S3 outage?

ObjectiveFS implements strong checksums to detect data corruption and to verify that the data retrieved from S3 matches with the originally stored data. This makes sure that the data integrity remains intact. ObjectiveFS also verifies that the first level index matches with their checksums when a filesystem is freshly mounted. Any checksum mismatches will always be reported in the log and the operation will be retried.

If your S3 bucket is in a region affected by an S3 outage, ObjectiveFS will always retry requests to S3. So, any pending reads and writes to S3 will be retried until S3 is back up again as long as the filesystem remains mounted on your server.

One useful tip: you can set the AWS_DEFAULT_REGION environment variable to the same region as your S3 bucket. This avoids querying the S3 global endpoint (s3.amazonaws.com) at filesystem start up, which can reduce the impact of an outage if your region is still fully functional.


Security and Integrity

Do you have access to my data?

No. Your data is encrypted locally on your server by ObjectiveFS. The encrypted data is sent directly to AWS S3 or GCS and stays encrypted until it returns to one of your servers.


What crypto algorithm are you using?

ObjectiveFS uses the NaCl crypto library, with modern algorithms such as Salsa20 and Poly1305, to keep your data secure. This approach has no data-dependent branches or data-dependent array indices, and protects against cache timing attacks that some AES implementation is vulnerable to.


How do I verify the integrity of my data? Is there a way to perform an fsck on ObjectiveFS?

ObjectiveFS implements strong checksums to detect data corruption and to verify that the data retrieved from S3 matches with the originally stored data. This makes sure that the data integrity remains intact.

A successful mount of an ObjectiveFS is similar to a successful fsck. When a filesystem is mounted, ObjectiveFS automatically verifies the checksums of the first level index. When data is read from your filesystem (on either a new mount or an existing mount), ObjectiveFS also verifies the checksums to detect any data corruption. Any checksum mismatches will always be reported in the log and the operation will be retried.


Performance and Support

How fast is it?

Very fast. The performance is similar to accessing a local disk. We use workload adaptive heuristics, advanced caching and bundled writes to achieve this performance.


How does ObjectiveFS’ performance compare to EFS?

See Performance: Amazon EFS vs ObjectiveFS.


Does ObjectiveFS support GovCloud?

Yes. ObjectiveFS supports GovCloud on the Business and Enterprise plans. Please contact support@objectivefs.com if you have any questions.


Does ObjectiveFS run on Windows?

Currently no. However, you can run ObjectiveFS on a linux machine and export to Windows via NFS (see details) or Samba (see details). Please email support@objectivefs.com if you would like native Windows support.


Questions?

If you have a question, please email us at support@objectivefs.com.