Menu Content/Inhalt
Home Developer Blog
  • English
  • German
  • Japanese

News Feed

feed-image RSS 2.0
fre:ac Developer Blog

Welcome to the fre:ac developer blog. I will post status updates and other information about fre:ac development here.



fre:ac development status update 11/2019 Print
Written by Robert   
Sunday, 01 December 2019 16:51

Hi all, unusually punctual, here is the November 2019 status update on fre:ac development. It has been an exciting month with lots of improvements and an important decision.

fre:ac 1.1 beta is coming

Feature development for fre:ac 1.1 has been completed. Yay! I currently plan a beta release for mid December (probably the 15th) and I'm currently preparing everything for that release.

Translators needed

Part of the preparations is to contact translators and ask for updates to existing translations. While many are already working on updating their translations for the beta, some were not reachable due to outdated mail adresses or are not available for doing translations any more.

This is where you can help! If you speak any of the languages marked as needing a new translator on this GitHub page or would like to contribute a completely new translation, please post a comment there or contact translations@freac.org to get involved with translating fre:ac. Any help is greatly appreciated!

I also set up a project on Crowdin, a community platform for collaboratively working on translations. Everybody can contribute translation updates or even just suggestions for improving individual translated strings there. So have a look at the fre:ac project page on Crowdin to see where you can help.

Logging support

Support for creating log files was the last feature planned but still missing for fre:ac 1.1. It has been completed and pushed to the code repository in mid November, paving the way for the upcoming beta release.

New versions of fre:ac will now create log files of conversions in a dedicated logging folder, keeping them for 30 days by default. You can also choose to have conversion logs stored with the resulting audio files and there is an option to do this only for CD ripping jobs.

The log files contain a header with some general system information like the operating system, processor and CD drive used, followed by a detailed log of all file actions during the conversion process as well as verification results if applicable.

Keyboard input fixes

Two issues with keyboard input have been fixed in the past weeks, affecting mostly users of non-English keyboard layouts. The first one being an issue writing accented characters (using a dead accent key followed by a character key) on Linux after switching the keyboard layout. In some cases it could happen that fre:ac omitted the accent in this situation and recorded only the plain character (so ´ + a would not result in á, but print just a).

The second issue affected keyboard layouts that use AltGr+A,C,V,X,Y or Z to write diacritic characters. A notable example is the Polish layout which uses AltGr+A for the ą character and AltGr+Z for ż. These key combinations led to executing the Select all and Undo commands respecively before writing the character on all systems except macOS (which uses an extra command key for performing clipboard actions).

Both issues have been fixed now.

Smaller changes and improvements

There have been some smaller changes and improvements last month as well:

  • SuperFast mode enabled by default
    The SuperFast mode discussed in several posts here earlier now got enough testing to be enabled by default for the upcoming beta. This can speed up conversions to MP3, AAC, Opus and Speex significantly, especially when doing output to a single file or converting less files than your system has CPU cores.
  • Support for 32 bit content in Monkey's Audio files
    The Monkey's Audio (APE) codec recently got updated to support 32 bit content (it was limited to 24 bit sample resolution before). fre:ac now recognizes this and allows encoding Monkey's Audio files with 32 bit resolution.

Bug fixes

Apart from the mentioned improvements, some bugs have been fixed too:

  • Fixed drag & drop on macOS
    Drag & drop support on macOS has always been a bit unreliable with fre:ac. Fortunately, I now identified the reason and was able to fix it quickly. Unlike other OS', macOS does not send mouse position updates when in drag & drop mode. Because of this, fre:ac often had the wrong position for the drop action which in many cases lead to the action being ignored.
  • Fixed conversion of long files with external decoders
    There was a bug with converting long running files that need an external decoder, such as AC-3. As soon as the internal decoded representation of such a file exceeded 4 GB, fre:ac would no longer show the file's duration nor any progress during conversion and pop up an error message at the end of the conversion process even though the file had been converted properly. This is all fixed now.
  • Stability fixes for Haiku
    The Haiku operating system, unlike most other OS', has a multi-threaded UI system. This led to some instabilities when running fre:ac on Haiku due to missing synchronization between UI threads in a few places. The next release should fix this and run much more stable on Haiku.

The upcoming fre:ac 1.1 beta will ship with all these fixes.

Other notes

Two features already discussed in the August and May updates respectively have been committed to the code base now:

  • Dark mode support for macOS
    This has taken escpecially long to finish as it required a total overhaul of fre:ac's macOS UI code as well as a new synchronization mechanism to avoid lock ups. The latter should improve stability on non-Apple systems too. Everything is done now, so you will be able to enjoy the upcoming fre:ac 1.1 beta in dark mode on macOS.
  • Support for using the iTunes store app's AAC encoder
    This was already announced in May, but only pushed to the code base in November as finalizing dark mode support had a higher priority, but this feature needed some compatibility improvements in order to work on all computers.

That's it for this month's issue. Be sure to come back mid December for the fre:ac 1.1 beta and in January for the next development update.

 
fre:ac development status update 10/2019 Print
Written by Robert   
Sunday, 10 November 2019 14:30

Hi all, this is the fre:ac development status update covering the months of September and October 2019.

Several improvements have been implemented in these past two months along with some bug fixes. So let's have a look at the changes in detail.

RNNoise model selection

The RNNoise noise reduction code has received an update earlier this year that allows configuring the neural network with different noise reduction models. Several models are provided to accomodate different combinations of speech or general audio with ambient or recording noise.

The model to use in the DSP chain of a conversion is now configurable in fre:ac.

Tagging improvements

Several improvements related to tagging have been implemented in the past two months:

  • Chapter support for APEv2 tags
    This brings chapter support to formats like Monkey's Audio (APE), TAK, WavPack and Musepack to enable single file album images that can later be split into individual tracks without the need for a separate cue sheet file.
  • Recognize album art when loading cue sheets
    Album art is now recognized when loading tracks to the joblist using cue sheets.
  • New tag fields
    In addition to the tag fields mentioned in the 08/2019 update, support for the Performer, Arranger, Producer and Engineer fields has been added.
  • CD-Text support on macOS
    The macOS version of fre:ac is now able to read CD-Text information from discs that carry it (mostly Sony releases).

Bug fixes

The following bugs and issues have been fixed since the last update:
  • Improved drag & drop on macOS
    Drag & drop support on macOS has been a bit wonky up to now, which was found to be caused by mouse pointer updates not reaching the program in drag & drop mode. This is now fixed in the code base and will work much more reliably in upcoming releases.
  • Fixes for gapless MP4 AAC
    When using MP4 AAC in non-LC mode (meaning e.g. HE or HEv2 AAC), decoding was not always gapless. This has been fixed to allow sample-exact decoding with any AAC mode.
  • Fixed support for very long MP4 AAC files
    Very long AAC files with durations approaching 20 hours need 64 bit fields to store their duration internally. This was not really supported until now and is now implemented.
  • Fixed crashes and hangs
    While working on everything mentioned above, several causes for crashes and hangs have been identified and eliminated. Future fre:ac releases should run much more stable with these fixes.

Other news

One more thing worth mentioning here is that the Xiph.org Foundation has released updates to the Ogg and FLAC libraries including patches to support the faster CRC checks I implemented for fre:ac in 2018. This can speed up FLAC by 5% and Ogg FLAC by up to 15%. Performance improvements for lossy formats based on Ogg are usually in the 1-2% range.

Another update is the 19.08 release of the Flatpak runtime. fre:ac's Flatpak package has been updated to make use of the new runtime and I took the chance to also update codecs to their latest version while at it.

That's all for this issue. Make sure to come back for the next update in one or two months.

 
fre:ac development status update 08/2019 Print
Written by Robert   
Saturday, 07 September 2019 12:16

Hi folks, here's the latest fre:ac development status update covering the months of June to August of 2019.

Yes, it's again been three months already since the last update. While my goal is to write monthly reports, my free time is limited and especially in summer, working on fre:ac is competing with other activities like cycling and kayaking, so needless to say it's suffering a bit. The upcoming rainy autumn and cold winter should lend themselves better to spending time on open source projects though. ;)

As already teasered in the previous report, I have some exciting news today and it's about fre:ac's I/O performance.

I/O performance improvements

Doing most of my testing on a relatively fast SSD, I usually found fre:ac's I/O performance to be just fine. It turned out, however, that when putting the output folder on an HDD drive, it can be horribly slow.

This is especially true when doing parallel conversions with lots of threads and writing to an internal HDD. A user with a 16 core / 32 thread Threadripper system approached me, claiming the conversion performance would not scale beyond 8 threads and asked me to have a look at that.

Well, I did and found that while performance was OK when the output folder was on an SSD, it could be more than 20 times slower when writing to an HDD. Looking at the I/O performance in Task Manager revealed that fre:ac was writing a mere 6 MB/s when the disk should be capable of much higher throughput.

The reason turned out to be an oversight of mine when implementing the audio file I/O layer. While fre:ac's I/O system uses buffered I/O in most cases - data is collected in a buffer first and then written in larger chunks - this was not true for most audio data writing (due to a lower - closer to metal - layer being used there). For the low level calls used for writing audio data, buffering was not enabled, leading to audio data being written in many small chunks and congesting the operating system's I/O queue.

Fixing this by enabling buffering on the low level I/O calls instantly improved performance by a huge margin. Here are some numbers for before/after performance with different target formats:


Converting 2586 mixed songs to MP3


Converting 2586 mixed songs to FLAC

So we're looking at a 4x performance increase when writing small (MP3) files to an HDD and up to 20x speed-up with large (FLAC) files. And even when the output location is on an SSD we are seeing more than 2x improvement in some cases. I did see even higher performance gains when converting a smaller number of files, as disk and OS write caches have a larger effect on the result in that case.

If you are on Linux, you can already try these improvements with the continuous AppImage builds or the edge channel Snap.

Multi-threaded adding to joblist

Sometimes, thinking again about a feature previously thought to be difficult to implement will bring up new ideas for a simpler approach. In June, a user brought up the topic of using multiple threads when adding files to the joblist. While I thought about that before, I deemed it too complex to realize in the fre:ac 1.1 development cycle - it was thus on my list for possible 1.2 features.

Thinking about this again, however, I quickly came up with an approach much simpler than my previous ideas. In short, the algorithm assigns tasks to threads in a round-robin manner while the actual adding to the joblist is still done in a single management thread. This is a bit less efficient than an ideal solution, but is so simple in fact, that it could be implemented in just a few hours and without much risk to break anything else in the program.

So this is now implemented and in combination with the aforementioned I/O improvements and some other optimizations, it can greatly speed up the time needed to add files to the joblist. Adding my test library of about 2600 songs in different formats now takes roughly 10 seconds with these changes compared to about 2 minutes with the 20190423 release:

I included the 1.0.32 release in this comparison as it was actually faster than the 20190423 snapshot. This is due to the development releases reading a lot more information (like cover art) from the files. Also, adding the tracks to the tag editor in addition to the joblist takes some time, so it's good to see the new code outperforming any previous version of fre:ac.

As with the I/O improvements, Linux user can already try these changes with the continuous AppImage builds or the edge channel Snap.

Dark mode on macOS

fre:ac in dark mode on macOSIn July and August, I was mostly working on implementing dark mode support for the macOS version of fre:ac.

There actually are two aspects to this. The first being actual work on support for dark color schemes - some elements had colors hard-coded to a value fit for a light theme only. The second - and vastly more difficult one - is reworking the drawing code architecture of the macOS version. The old drawing code used some deprecated patterns no longer allowed in modern macOS. Applications built using an older SDK and supporting only light mode can run in a compatibility mode, however, which is what fre:ac is still doing in the latest release. As soon as you declare dark mode support though, your application will no longer run in compatibility mode and will have to implement the latest drawing paradigms.

So this took a while to implement and is not quite finished yet, but should be fully integrated within the next one or two weeks.

Smaller improvements

  • Multi-channel Monkey's Audio
    The Monkey's Audio codec got support for multi-channel audio in a recent release and fre:ac now supports that.
  • Tagging improvements
    Some tag fields previously only available in ID3v2 tags are now supported in a wider range of tagging formats. This mostly effects the Mix artist, Grouping, Disc subtitle, Copyright and Catalog number fields.
  • Bug report and feature request templates
    The fre:ac issue tracker on GitHub now has templates for bug reports and feature requests which should help improve the quality of issue descriptions and ultimately make it easier and quicker for me to help.

Besides these improvements, several bugs have been fixed in the past three months. I'm working towards publishing a new release, but cannot give a definite time frame for it yet.

That's it for this issue. Make sure to come back here for the next one (hopefully in one month ;)).

 
fre:ac development status update 05/2019 Print
Written by Robert   
Thursday, 06 June 2019 21:00

Hi all, this is the fre:ac development status update covering April and May 2019.

A lot of interesting things have been worked on in the past two months including a new alpha release, continuous builds for Linux and several improvements and fixes.

New alpha release

The 20190423 alpha release now allows ripping with more CD drives than your system has CPU cores available. This was requested by a user who planned to connect 10 drives to his quad core system for ripping his music collection of several thousand CDs. As the CD drive's reading speed is usually the limiting factor when ripping with the CPU not fully utilized, most modern systems can easily handle multiple ripping threads per CPU core. Previous versions were limited to one thread per core, so the new release allows for great speed ups of such large scale conversion jobs.

Other than that, the new release ships mostly bug fixes. Everything already mentioned in the last report plus some last minute changes:

  • Added support for cue sheets referencing multiple multi-track files
  • Fixed decoding of very short Ogg files (Vorbis, Opus and Speex)
  • Fixed more thread synchronization issues to improve stability

Continuous AppImage builds

The Travis CI system now builds AppImage packages for the four major architectures (i686, x86-64, ARM and ARM64) for every commit to the code repository.

This means that if you are on Linux, you can now try out the latest changes almost immediately. You can find the continuous builds on the downloads page and on GitHub.

iTunes store app support

For users of Windows 10, iTunes is now offered as an app download from the Microsoft store. Unfortunately, this means that the current integration method for the Core Audio encoder with fre:ac no longer works. You currently need to explicitly select and install the non store version of iTunes in order to continue using this high quality AAC codec in fre:ac.

This will be fixed by using an adapted integration method starting with the next fre:ac release. The new version will detect an installed iTunes app and load the Core Audio codec that comes with it.

Other fixes and updates

Several minor updates and fixes have been implemented in the past few weeks and will be included in the next release:

  • Improved support for album artist in cue sheets
  • Using album artist for single output file name
  • Fixed issue with playlist/cue sheet placement when "Use input file folder" option is used
  • Fixed invalid file time for CD rips when using "Keep time stamps" option
  • Fixed ID3v2 implementation being not completely standards compliant

That's it for this issue. Be sure to stay tuned for the next one which will have some exciting news!

 
fre:ac development status update 03/2019 Print
Written by Robert   
Wednesday, 27 March 2019 19:35

Hi all, here's a new fre:ac development status update. I missed the January and February updates and thus decided to do this one a bit earlier. Also, I'll be on vacation the next two weeks, so there's not much more development going to happen in March anyway. As this report is covering almost three months, it got much longer than usual.

Snap and AppImage packages

After introducing Flatpak packages for fre:ac in December, I worked on getting Snap and AppImage packages up and running in January. As a result, fre:ac is now available in the Snap store and AppImages have been added the the downloads section.

Also, since just a few days ago, continuous builds of fre:ac are now available as Snaps in the edge channel of the Snap store (with official releases now listed in the beta channel). I also sorted out an issue with the build process on the ppc64el architecture, so if you have such a machine, you can now enjoy fre:ac as well.

Following this, continuously built AppImages will hopefully be available soon too.

PulseAudio output component

The Linux versions of fre:ac will make use of the PulseAudio sound architecture starting with the next alpha release. This replaces the previously used ALSA output component and enables you to control fre:ac's volume independent of other applications in your desktop's mixer. It also simplifies the process of packaging fre:ac as a Snap and helped making continuous builds available.

Media Foundation WMA decoder

On the Windows platform, the WMA decoder based on Microsoft's Windows Media Format SDK has been replaced by one building on the newer Media Foundation APIs. The new decoder is used on all systems that support Media Foundation and works around a WMA Lossless decoding bug on recent versions of Windows 10.

Improved playlist files' interoperability

A user noted that M3U playlist files generated by VLC could not be opened in fre:ac (via the File->Load joblist feature). Turned out that VLC is putting file: URIs in its M3U files and fre:ac was not ready for that. This is now fixed so the next release will be able to handle such files.

A similar issue existed with XSPF playlists. With this format though, in addition to fre:ac not being able to handle VLC's files, the latter also could not open files generated by fre:ac. The next release fixes this and will provide complete XSPF interoperability between the two programs.

Bug fixes and minor improvements

In addition to these bigger changes, a lot of bug fixes and smaller improvements have been implemented since the beginning of the year:

  • Fixed conversion failing for MP4 and WMA when input and output files are the same
  • Fixed 32 bit float encoding with Core Audio turning up noisy output files
  • Fixed Opus file output (vendor string, granule position)
  • Fixed Ogg serial number generation
  • Fixed occasional crashes when changing radio button values on Windows
  • Fixed CDDB multi-match dialog crashes/hangs on X11 systems
  • Fixed thread synchronization issues with CDDB queries on macOS
  • Fixed a framework issue leading to memory leaks on all platforms
  • Don't remove files from the joblist in case of a conversion error
  • Show only one error dialog when adding multiple folders by drag & drop

Performance and compatibility updates for Monkey's Audio

Not directly related to fre:ac, but still noteworthy, I recently sent some more patches to the author of the Monkey's Audio codec. These provide better compatibility with Linux and Unix-like systems and speed up decoding by approximately 5% by using a faster CRC calculation algorithm previously only used for encoding plus some other optimizations.

That's it for this issue. I will be on vacation now and hope to be able to cut a new alpha release soon after I'm back. Watch for it around mid to end of April!

 
fre:ac development status update 12/2018 Print
Written by Robert   
Saturday, 05 January 2019 23:18

Hi and welcome to the latest fre:ac development status update! I did not write a report for November as I was busy preparing the latest alpha release around the end of the month, so this report covers both, November and December of 2018.

BeGeistert 2018

On the 3rd and 4th of November I attended the BeGeistert 2018 Haiku developers conference which was held in my hometown of Hamburg, Germany. I met great people from the Haiku project, got to work on the fre:ac port for Haiku and ported Monkey's Audio over.

It was a great event and a nice experience and I'm already looking forward to attending future BeGeistert meetings in the years to come.

Flatpak (and work on Snap)

The big news for December certainly is fre:ac finally being available as a Flatpak. This makes it easier than ever for Linux users to discover and try out fre:ac.

The fre:ac Flatpak is available from Flathub, the largest application repository for Flatpak distribution.

Now that the Flatpak is ready, I'm shifting my attention towards building a Snap package as well. There already is some progress, but I did not get to work on the project a lot during the holiday season. Thus I now expect the Snap to be ready around mid January.

Enhancements

The December release of fre:ac added a notification component that can play a customizable sound or display a message box upon finished conversions. This was requested by several users doing very large conversions that might take anywhere from several minutes to hours. They often leave fre:ac running unattended, so an audible notification upon job completion can be useful.

Additionally, the December release now supports accent colors on macOS Mojave and improves scaling on HiDPI displays, especially with radio buttons and with edit fields where text was sometimes cut off in scaled mode.

Minor enhancements added in November and December include an option to switch stereo channels that was added to the channel converter DSP component and support for drag & drop in the tag editor. The latter did not make it into the December release though and will debut in the next alpha or beta.

Various fixes

In addition to the above changes, many bugs have been fixed in the past two months:

  • Fixed MP4 files not being created when <directory> placeholder is used in output filename pattern
  • Fixed tag editor being unable to open some file types on case-sensitive file systems
  • Fixed freaccmd issues when input and output files are the same
  • Fixed crash when converting mono to stereo
  • Fixed encoding mono MP3s

That's all for this issue. The report for January should be out in early February, so make sure to check the site for updates.

 
<< Start < Prev 1 2 3 4 5 6 7 8 9 10 Next > End >>

Page 1 of 11