Review of the APFS file system for Apple devices: what is the difference, how to use it? How to view the file system of an iOS device on Windows.
09/26/2017, Tue, 09:50, Moscow time, Text: Vladimir Bakhur
Final macOS version High Sierra For Apple Mac is already available for download. The list of the most significant changes includes a completely new file system, improved support for 4K, VR and HEVC, new features in Safari browser and photo editor.
Final update
Apple has officially unveiled the final commercial version of its macOS operating system, tentatively titled High Sierra, for Mac systems. Previously macOS High Sierra, at the 2017 WWDC developer conference, was only available as a beta version.
Apple emphasizes that the set of new technologies implemented in the new operating system will provide Mac systems with greater reliability, functionality and speed, and also “lays the foundation for future innovations.”
Among the key core technologies of the new macOS High Sierra, Apple especially highlights the new data storage architecture, enhanced transfer capabilities streaming video, improved GPU efficiency.
Apple File System
The new Apple File System (APFS), which first came to High Sierra to replace the 30-year-old “veteran” of the HFS/HFS+ family of file systems, has a 64-bit architecture and allows you to work with flash drives large capacity, while maintaining backwards compatible for reading and writing from HFS formatted media.
New 64-bit Apple File System
According to the company, the new file system performs most common operations much faster, such as determining the size of folders or copying files. APFS's list of benefits also includes built-in encryption, failover protection, and simplified on-the-go backups.
New codecs
Apple has fully adapted the new High Sierra OS to work with the new HEVC (High Efficiency Video Coding) video codec, also known as H.265. This codec allows you to compress video data without noticeable loss of quality more efficiently than the previous generation of codecs (AVC/H264, AVCHD 2.0) and is aimed at working with 4K video format and even 8K in the future.
The HEVC codec provides several advantages over the H.264 standard
According to Apple's own data, at the current stage of development of the HEVC codec, it provides video compression up to 40% stronger than with the H.264 codec, so HEVC video files take up less space without sacrificing quality and are transmitted faster.
Metal 2: advanced graphics and virtuality
Integrated into macOS High Sierra a new version Metal 2 technology has full support machine learning, external discrete graphics and virtual reality.
Mac users running macOS High Sierra will now be able to experience a variety of VR experiences with the first support for Valve's SteamVR headset and HTC Vive VR headset.
Metal 2 technology supports external graphics and virtual reality
Mac users now have the ability to create interactive applications virtual reality on the new iMac with Retina display 5K and the new iMac Pro coming late 2017, as well as other supported Mac models when connected external video card. Special attention focuses on a number of Apple's visual content creation applications, including Final Cut Pro X, Epic Unreal 4 Editor and Unity Editor.
Advanced App Features
In macOS High Sierra, Apple introduced a significantly redesigned Photos app for organizing and editing your photo collections, linked to iCloud Photo Library.
The Photos application has improved functionality
The Photos app features a redesigned side menu, expanded and expanded editing features, including Memories, Moments, Collections, and Years for organizing and curating your favorite photos, People with a facial recognition tool, and Places » with the location of the photo on the world map and search by keywords.
The Markup feature lets you add text, graphics, sketches, and captions to your images. The Enhance feature allows you to enhance the quality of your photo with one click, and numerous filters allow you to automatically change the style and make professional-grade edits using smart sliders. Additional extensions, filters and textures from third-party developers for photo processing are available in Mac App Store.
New features in the Photos app
Pictures Live Photo s using the Loop effect, you can turn videos into loops and then share them on social networks. The “Pendulum” effect will allow you to play video forward and backward, the “Long Exposure” effect will allow you to simulate a long shutter speed on DSLR camera to blur the texture of water or lengthen the rays of light.
After editing a photo in Photoshop or Pixelmator, the changes are automatically saved in the Photos app's library. After taking a photo or video on your iPhone, the footage automatically goes to the iCloud Photo Library and becomes available for viewing on Mac, iOS devices, Apple TV and PC.
Record FaceTime video calls as Live Photos
The macOS High Sierra operating system has learned to record FaceTime video calls in Live Photo format. After the communication session, both subscribers receive a notification about the created photo, and the Live Photo is saved on the device in the Photos library.
Organizing an iCloud cloud library
iCloud Photo Library provides 5GB of storage for free, with the option of further paid upgrades. With Optimize Mac Storage, all high-resolution photos and videos will be stored exclusively on iCloud, while smaller versions will remain on your Mac.
New functionality for the Mail app
The search function in the Mail application has been significantly improved and expanded: it has now become faster, more convenient, and has the ability to transfer the most relevant letters to top part list with the “Best matches” function. The Mail search takes into account the hierarchy of contacts, correspondence read and sent, and a number of other factors. Apple notes that search in Mail is now also self-learning, and works better with frequent use of this feature.
Safari: now with smart protection and without traces
According to Apple's own data, the Safari browser on macOS is again the fastest and outperforms Chrome in most tests. Introduced in macOS High Sierra, Intelligent Tracking Prevention uses machine learning to help Safari recognize who is tracking your online activity and delete the data collected.
Safari browser gets machine learning feature
Safari has also learned how to mute the sound when playing advertising videos. If necessary, launching videos with sound can be enabled by default in individual browser settings, or for individual websites.
For certain sites, you can also configure Safari's zoom level, use geolocation, show notifications, and block content.
Web pages that support Reader view automatically open in Safari without ads, navigation buttons, or other distractions.
Siri: more humane
In the new macOS High Sierra, the timbre and intonation of Siri’s “voice” have become more natural and varied, and semantic accents have become more precise.
Siri continues to improve its artificial intelligence and now, using the built-in machine learning function, remembers the user's musical tastes when listening to music in Apple Music, and then can offer something new in the same style.
Enhanced Siri functionality in macOS High Sierra
Now you can ask Siri to play something calm. Siri can also read the description of a song and provide information about new songs and artists.
Compatibility and updates
The new macOS is available now as a free update or direct download from the Mac App Store.
The new macOS High Sierra has similar system requirements as its predecessor, version macOS Sierra. Thus, all systems running Sierra can be upgraded to High Sierra.
Apple says that everyone has received full compatibility with the new macOS High Sierra operating system MacBook models and iMacs released after 2009, as well as platforms MacBook Air, released after 2010, and MacBook Pro, Mac mini and Mac Pro introduced after mid-2010
It would seem that there is nothing interesting. However, Apple still rolled out something fundamental. The most significant development of all mentioned at the presentation is the next-generation Apple File System (APFS) in the macOS (Sierra) 10.12 operating system.
Documentation with the main characteristics and description of the file system, which repeats individual functions of the powerful free file system ZFS, was published on the website for developers shortly after the presentation.
Now in Apple computers The HFS+ file system is used, an extended version of HFS (Hierarchical File System, hierarchical file system), created more than 30 years ago. Like its predecessor, HFS+ uses a tree structure called a B* tree to store most of the metadata. Hence the name “hierarchical file system”.
The official introduction of HFS+ took place on January 19, 1998, along with MacOS 8.1. Since 2002, the system has implemented logging to increase the reliability of information storage. Since version OS X 10.3, logging is enabled by default, and it is now possible to work in case-sensitive mode.
Up until OS X 10.7, developers continued to refine HFS+ and implement new features for OS X at the file system level. But the fact remains: HFS was originally developed in the days of floppy disks and spinning hard drives, when file sizes were measured in kilobytes or megabytes. Today, many people work with SSD drives, where millions of files are stored - gigabytes or terabytes of data. Completely different requirements are put forward for the file system. Instead of reworking the old code, Apple decided to finally write a new file system from scratch.
The next generation APFS file system is still at the stage developer preview, that is, it is not planned to be rolled out into mass use in the near future. At this time, the APFS volume cannot be used as a boot disk, nor can it be used in a backup system. copy time Machine, in Fusion Drive or with File Vault encryption. But it is possible for a regular non-bootable volume.
There is still a lot of development and testing ahead, but only then APFS will become Apple's main file system for decades to come.
APFS, unlike HFS+, inherently distinguishes the case of characters in file and folder names, and this feature cannot be disabled. This should be kept in mind by anyone who decides to use APFS.
Main characteristics
The official documentation lists the general characteristics of the APFS file system in comparison with HFS+.Containers and volumes
Container is the main object for storing data in APFS. Containers are usually exactly the same as GUID Partition Table (GPT) entries, and they have their own failure protection and disk space allocation scheme. Each container contains one or more volumes or file systems, each of which has its own namespace, that is, a set of files and directories.APFS does not directly support software RAID, but it can be used with Apple volumes RAID to support Striping (RAID 0), Mirroring (RAID 1) and Concatenation (JBOD).
64-bit inodes
64-bit inodes significantly increase the namespace compared to 32-bit inodes in HFS+. The 64-bit APFS file system supports more than 9 quintillion files on each volume. This should be enough for everyone, as Bill Gates said.Nanosecond timestamps
APFS has significantly increased the accuracy of timestamps. APFS supports timestamping with nanosecond precision. For comparison, in HFS+, time stamps were set with an accuracy of up to a second.Nanosecond timestamps are very important in modern file systems because they help implement atomicity and atomic transactions - one of the main ACID requirements for a transactional system (for example, a DBMS). Atomicity ensures that no transaction is partially committed to the system. Either all of its sub-operations will be performed, or none will be performed.
Failure Protection
APFS implements an innovative copy-on-write metadata scheme that Apple calls “Crash Protection.” It ensures that file system changes and log writes remain synchronized if something happens while the write is in progress, such as a power failure.Copy-on-write scheme in ZFS
Sparse files
A file with the “sparse” attribute assumes that it contains blocks of zero bytes that are not stored on the drive, but are implied. HFS+ did not have support for sparse files.Extended Attributes
APFS has built-in support for advanced file attributes, which in HFS+ was implemented through the Attributes file, that is, through a B-tree.Encryption
Apple says encryption is fundamental property, which is built into APFS at the file system level. For each volume in an APFS container, one of the encryption models is set: no encryption, single-key encryption, or multiple-key encryption. In the latter case, separate keys are used to encrypt files and metadata. Depending on the hardware, APFS uses AES-XTS or AES-CBC encryption mode.Cloning files and directories
Cloning is an almost instantaneous copying of a file or directory, which does not require additional data storage space. When a clone is modified, the file system only records the data change. This way, the new file system can store many versions of large files while taking up less disk space.Snapshots
Snapshots are read-only snapshots of the file system on a volume. The operating system can use snapshots for more effective procedure Reserve copy. That is, finally Time Machine will work normally (fast).Of course, APFS is significantly inferior in its capabilities to the 128-bit file system ZFS, which is supported by Linux, FreeBSD and other free operating systems, but on Apple's part this is a step in the right direction.
It is strange that the preliminary documentation does not mention the compression function, which HFS+, by the way, supports.
Apple has been trying to port ZFS to the OS X system for a long time, there was an active discussion about this on the ZFS mailing lists, preliminary snapshots were published for the next version of OS X. Later, an implementation of OpenZFS was made for OS X (O3X) and MacZFX.
File ZFS system distributed openly source code, and Apple may well have borrowed some ideas for the APFS file system. Implementation open source for APFS is not yet ready, Apple plans to document and publish the APFS format in 2017.
The first formal session will take place at WWDC this evening, where the new APFS capabilities will be demonstrated to developers in more detail.
Denotes Apple's new file system and will eventually be used on all of the company's major platforms. But why does Apple use it? What's so special about it? This article is devoted precisely to this topic.
Apple File System
The abbreviation APFS stands for Apple File System. It replaces the file system and over time this file system will become an integral part of iOS, tvOS, and watchOS - that is, it will be used across the entire line of devices: from computers, iPhone, iPad, Apple TV and devices Apple Watch.
Currently iOS time 10.3 is the only publicly available platform that uses the APFS file system.
APFS can be integrated on all platformsApple.
The HFS+ file system appeared in 1998 and is now almost 20 years old. She has become a relic of a bygone era. It was created in the era of Mac computers and modified for use in iPhone devices, Apple Watch and Apple TV.
But a lot has changed over the past 20 years. We switched from hard drives on solid state drives SSD, the software is no longer distributed on CDs, but is simply downloaded. Our devices are now backed up in cloud services.
Optimized for working with flash drives
These days, almost every new device Apple sells runs on a flash drive, including most Mac computers. And APFS was designed to work with flash-based storage devices. Therefore, we will see improvements in parameters such as read and write speeds, and an increase in overall reliability when it comes to storing and transferring information.
main feature: System snapshots and cloning
The two main features of APFS are the ability to take snapshots of the system and the ability to clone data.
A snapshot represents a one-time read-only state of the file system.
Using clones, APFS will be able to create quick copies of the same partition without using additional disk space.
Minimum waiting time
APFS has minimum time expectations. This means that operations such as launching applications and loading data will be noticeably faster. Which in turn will lead to a reduction in waiting time - we will see less of the spinning wait wheel in iOS and the beach ball icon in Mac OS.
Availableflowing disksections
If you use disk partitions on your Mac computer, then APFS can make your life a little easier. If free time runs out disk space on one partition, APFS can automatically use the free space of another partition because APFS creates special containers around each disk partition.
Encryption is everything
APFS was primarily designed for strong encryption. It supports both single key and multiple encryption keys.
Developments for the future
HFS+ supports 32-bit metadata file. APFS supports 64-bit inode numbers. APFS was designed to work in the future and will perform even better over time as appropriate updates are released.
FirmwareiOS 10.3 gives you back disk space
There is one clear benefit to switching to APFS. You get disk space at your disposal - the amount of space saved will depend on how full your disk is. Some managed to get a couple of gigabytes back after updating.
APFS for Mac OS is still in beta version
iOS already uses the new file system, but for Mac OS the new file system is only available in a very early beta version. AND Apple It will take a lot of effort to convert Mac computers to use APFS. Access to the file system in iOS is closed to outsiders, but Mac OS uses an open, editable file system. In other words, APFS in practice may encounter various edge cases that Apple experts are not even aware of yet. We hope that all these issues will be resolved during the beta testing period. You can try the beta version in action. True, she's not quite ready for everyday use. APFS does not support boot drives, Time Machine, FileVault encryption, or Fusion drives.
Yes, you need to update toiOS 10.3
Currently, iOS 10.3 is the only way to try APFS in action. And despite the fact that this is a completely new file system, it is nevertheless worth switching to. This update has been tested for several weeks by a large number of beta testers and everything speaks in favor of switching to the updated version. The transition itself occurs quite smoothly, quickly and without data loss. However, before updating, we recommend, just in case, backup your data using the appropriate iTunes application services or iCloud cloud storage (which is recommended in any case).
How do you like itAPFS?
At the last WWDC, Apple introduced a new file system - Apple File System, or APFS. Although HFS+ is used on all Apple products (and will be used for at least another year, APFS is scheduled for release in 2017), HFS+ does not meet the requirements of modern file systems. It is over 30 years old and was created for a time when floppy disks and hard drives were considered the latest technology. To use HFS+ on iOS, tvOS and watchOS, Apple had to add completely third-party functionality that is not supported on macOS: for example, encryption for each individual file.
The new APFS has added so many features that it’s dizzying: optimization for Flash and SSD, protection against data loss during crashes by increasing the number of atomic operations, built-in support for several types of encryption, greatly reduced response time, quick estimation of the size of files and folders - the list goes on and on. In this article, we'll look at four of what we think are the most interesting features of the new file system.
Secure Copy-on-write
First, we'll have to understand a few key terms. Atomic operations are operations that are performed inseparably on a file system or database and cannot be simplified. An atomic operation cannot remain unfinished if it is interrupted. Such an operation is either performed completely or not at all. POSIX-compliant secure atomic file storage is performed as follows - when we work with an application and save a file, data from memory is downloaded to a temporary file on disk. When the application is confident that the data has been downloaded completely and without errors, the application queries the file system about renaming. The renaming operation is atomic; it will either be completed completely or not at all. When renaming, what happens is that the file system moves the temporary file to the save location (say from /var/tmp/Batcave_shopping.pages to ~fedor/Documents/Batcave_shopping.pages) and then deletes the old file.
However, what if we are saving not a file, but a folder or Bundle (for example, .rtfd or .app, also, in essence, folders)? Let's say we are working with the document ~fedor/Documents/AlfredHappyBirthday.rtfd. This is a Bundle, it contains text and several images. When we make changes and save them, the application overwrites the entire Bundle, not just the changed text or image. POSIX requirements do not allow you to rename a folder somewhere where there is already data, so you have to resort to tricks. The document is moved from ~fedor/Documents/ to free up space, then the temporary file in /var/tmp/AlfredHappyBirthday.rtfd is renamed to the empty space. This operation is non-atomic and unsafe. If a system error occurs or the computer loses power during an operation, the document will be lost.
Obviously, such a solution is undesirable. Therefore, APFS introduced a new, POSIX-incompatible atomic safe folder save operation. When an application requests to save a folder, the temporary and permanent files are swapped. This is done by the file system and is an atomic operation.
This is the secure Copy-on-write feature - one of the most important innovations in APFS.
Cloning and snapshots
If you need a copy of a file or folder, you right-click on it and select Duplicate. In HFS+, this means that the file system reads all data and then writes it to free space. This approach is an inefficient use of space and wastes the disk and processor load. In APFS, when you duplicate data - via Duplicate or simply ⌘C, ⌘V - the file system copies only the link to it (the so-called hard link), and the content is not duplicated. This operation is called cloning. Thanks to cloning, a duplicate of data or folder appears almost instantly, and takes up a negligible amount free space. If you make changes to the original or clone, the file system will record the changes and redirect the link accordingly, leaving the original piece of data untouched. In APFS, the cloning operation is atomic.
Snapshots is a specific snapshot of a volume that stores information about the data on that volume at a specific point in time. The easiest way to understand how it works is with an example. Let's say we have a volume (let's say a flash drive) with two presentations. We create a Snapshot of this flash drive, it contains two files Joker.key and Riddler.key, the files belong to next blocks data. The Snapshot itself does not contain data from the flash drive - only what files were on it at the time the snapshot was created and what blocks they belonged to. The peculiarity of Snapshot is that blocks written to it are closed. They cannot be deleted, moved or overwritten. Therefore, for example, if we make changes to Joker.key and delete Riddler.key altogether, the original data blocks will remain intact. Although this approach takes up additional free space, it allows APFS to almost instantly return the volume back in time to the point at which any snapshot was taken.
Space sharing
Space sharing is another very interesting feature APFS. Once again, the easiest way to understand it is with an example. Let's say you have a laptop with a 256GB SSD installed (it's very possible that you actually have one) and you want to install OS X El Capitan and macOS Sierra beta on it. Alas, Apple doesn't yet allow you to boot the operating system from an APFS volume (or use it for Time Machine, for that matter), so you'll need to create two HFS+ partitions. You launch Disk Utility and you are faced with a dilemma - how big should you make the partitions? You can simply split the drive in half, but what if you don't have enough space to run El Capitan comfortably? Or, on the contrary, will you overdo it and the applications you need won’t fit in Sierra?
APFS solves this problem with Space sharing. On a disk with APFS volumes at a higher level, a container is created containing all the volumes. They can freely and dynamically grow or shrink within such a container, without requiring the user to choose how large they should be. Let's return to our hypothetical laptop. If you use APFS instead of HFS+ for both volumes, both OS would report that 256 GB of space is available for each. At the same time, the space busy with files one system would be inaccessible to another. This solution greatly simplifies the work with multiple volumes and allows you to get the maximum benefit from their use without much difficulty.
Migration from HFS+
Finally, how can we migrate to APFS? The process of switching to a file system is usually difficult, long and not always safe. I have to do backup copy data to external media, erase HDD computer, write a new file system, install the OS, restore your data from a copy and hope that nothing has disappeared from its place.
Fortunately, Apple took care of this. The company's engineers did a lot of work on the migration process. The process consists almost entirely of atomic operations, but the main thing is that data about the new file system is written only to empty space on the HFS+ volume. This means that even if something goes wrong, it will not damage either your data or the structure of your existing file system. And according to Apple engineers, the entire migration takes just a few minutes.
Here we come to the end. We only talked about four functions, but there are many more in APFS. If you want to dive into the details, the official documentation has all the details. The new file system, as we mentioned above, cannot be used for boot disk or Time Machine and will not be supported on OS X Yosemite and older. Official release APFS is scheduled for 2017.
The best news often remains behind the scenes Apple presentations. The reason is that some of them are suitable primarily for developers, while others simply do not have enough time - no wonder, with such large-scale announcements of iOS 10! The emergence of a new file system from Apple called APFS (The Apple File System) passed without noise and dust, but the leak leaked to the Internet, and now nothing prevents you from studying it carefully.
APFS is a next-generation file system that can run on everything from the Apple Watch to the Mac Pro. The Apple File System is optimized for SSD/Flash drives, that is, the emphasis is no longer on hard disks, and the highest priority is given to encryption. Today, an older Cupertino development, HFS+, is widely used, with which APFS is worth comparing. But first, oddly enough, let’s describe the list of APFS limitations:
- APFS formatted partitions cannot be used as boot drives.
- APFS is sensitive to uppercase and lowercase letters in file names.
- Reserve copies of Time Machine are not supported in APFS.
- Partitions formatted in APFS are not suitable for encryption via FileVault.
- The Fusion Drive design flies past the APFS.
Also, APFS is not currently a project with open source, and Apple itself is unlikely to have similar plans for it. Moreover, the Cupertino team is only going to publicly announce their new generation file system next year.
Having described the shortcomings that can scare off the average user, it is worth identifying advantages of APFS:
- Of course, fruitful work with solid-state drives.
- The use of so-called containers as storage cells that are more protected from failures. In addition, each container can export one or more partitions, or file systems, with their own names, files and directories. Please note, that there is no direct RAID support initially stated, however APFS can be combined with an Apple RAID partition to allow RAID 0, RAID 1 and JBOD to work. Pluggable RAID arrays will also be able to make friends with APFS.
- APFS supports 64-bit inodes, while HFS+ file inodes are focused on 32-bits. APFS is capable of storing a quintillion files on a single partition. Believe me, this is a lot :)
- Time intervals in APFS are divided into nanoseconds, rather than seconds, as in HFS+.
- APFS supports sparse file structures that save disk space.
- The block distributor is designed more in a smart way: in APFS it determines the size of the storage volume, while in HFS+ it is always tied to a rigid frame.
- APFS has strong protection against data loss due to failure.
- APFS supports extended file attributes.
- TRIM in the APFS file system works asynchronously when removing and allocating free space, due to which the metadata is changed only once and ensures high system stability
- Encryption is the final and key component of The Apple File System. The file system uses full AES-XTS or AES-CBC encryption (depending on the hardware), combines principles laid down since OS X 10.7 Lion and iOS 4, and works with multiple keys.
This news article should be summarized with information about compatibility, since only OS X Yosemite, El Capitan and Sierra can work with APFS - older versions simply do not recognize it. Partitions formatted in APFS can be opened via SMB, but the AFP protocol will not be accessible. And finally third party developers will have to carry out a large-scale update of its products to support Apple's next-generation file system.