Library Manager RC9.x Updateable list

KurtE · September 8, 2022, 3:35pm

Sorry in advance as much of this has probably been covered before.

But I am curious about how the current RCs and how the Library Manager, update code decides on which libraries to update and what constraints it uses on doing this. I am curious as it is showing a ton of libraries need updating. And I have been bit in the past.

Sorry I know that is not a very clear question, so maybe better if I describe a few usages patterns.

a) I used library manager to install the library, and I have not mucked with the library at all. Assume if updates are available, then it shows up in list.

b) Installed by Board Manager, in the hardware... area for libraries. I assume these are not updated by library manager?

c) I install library some other way? zip file or the like. Assume it is not touched?

Now the more interesting cases:

d) I used library manager - And I modified the library manually? Does it check anything before it blindly updates?

d1) Library manager downloaded. Found bugs, download github project to make updates or are in the process of making updates. WIll it replace my github project?

d2) Like d1) except I download github to different directory (d:\github...) and then make a link to it in the /project (mklink /j ...) Again will it try to update. If so, will it remove the junction and update in the arduino library folder or will it update the github code.

e) I had a lot of libraries installed, my Arduino15 directory appeared to be corrupted (earlier when ESP32 specific install caused IDE2 not to start). So I deleted the Arduino15 and created a new one. So most of the libraries installed were orphaned. Will it only try to update those libraries that were installed after that, or will it try to update others?

Probably enough for now.

And again sorry if all of this has been asked before. I decided to post as to maybe then try to fill in some of these blanks myself.

Thanks
Kurt

P.S. - Still wish there was a described way to delete installed libraries. For example, maybe I downloaded the Adafruit ADXL343 library to help out someone on PJRC forum who was having issues. But when I was done with it, maybe I simply want to remove it.

Willem43 · September 8, 2022, 3:52pm

I also would like to see some answers to @KurtE 's questions posted above.

I have libraries which I specifically added changes to to suit some of my special needs. Now the new update facility wants to update them - I will lose my changes if it does while they work fine as is.

Also there are some libraries we do not want to update since the latest update causes incompatibility issues.

I really would like an option to not display the update notification when starting the IDE.

The new added facilities when opening the library manager is great and, for me, sufficient. I would not like to accidently hit the wrong option in the update notification.

ptillisch · September 8, 2022, 10:01pm

The first thing I should make clear is that the Library Manager and Boards Manager update capability was added in Arduino IDE 2.0.0-rc9.3. So this is the reason why you may now suddenly be finding that a lot of libraries or boards platforms are updatable. They were updatable even before, but previous versions of Arduino IDE 2.x had no mechanism for notifying the user about this so updates were only done by manually going through the libraries in Library Manager and installing a newer version.

Correct.

If the library is listed in Library Manager then it will be updatable via Library Manager regardless of how it was installed.

There is no mechanism for the IDE to determine how a library was installed. Manually installed libraries and Library Manager installed libraries are all just folders together under the libraries subfolder of the sketchbook.

Library Manager always installs the library to a folder named according to the name value specified in the library.properties metadata file of the library. This means that if you made a manual installation of a library to a folder matching that name, then the Library Manager update will overwrite the manually installed library. If you made a manual installation to a folder with a different name, then that folder will be left alone and a new folder will be added with the updated version, leaving you with two installations of the library.

For example, let's say you have manually installed a library with the following in its library.properties file:

name=Foo Bar
version=1.0.0

If a library named "Foo Bar" is in the Arduino Library Manager index and a new version (e.g., 2.0.0) is available from the index, Library Manager will offer an update.

If you manually installed this library like so:

<sketchbook folder>/
└── libraries/
    └── FooBar-main/

Then after the Library Manager update you will have this:

<sketchbook folder>/
└── libraries/
    ├── FooBar-main/
    └── Foo_Bar/

<sketchbook folder>/libraries/FooBar-main/ - contains the manually installed "Foo Bar"@1.0.0
<sketchbook folder>/libraries/Foo_Bar/ - contains the Library Manager installed "Foo Bar"@2.0.0

If you manually installed this library like so:

<sketchbook folder>/
└── libraries/
    └── Foo_Bar/

Then after the Library Manager update you will have this:

<sketchbook folder>/
└── libraries/
    └── Foo_Bar/

<sketchbook folder>/libraries/Foo_Bar/ - contains the Library Manager installed "Foo Bar"@2.0.0

No

Yes

I don't know. Give it a try and let us know what you find.

It is not clear to me what you mean by "orphaned".

Actions taken on the Arduino15 folder don't have any effect on the Library Manager. Library Manager works exclusively on the libraries in the libraries subfolder of the sketchbook. It does not recognize libraries from any other location. It never installs libraries to any other location. It never updates libraries from any other location.

Thanks for asking.

We have actually been discussing some of this within the Arduino Tooling Team over the last couple of days.

I have been preparing a couple of reports about this and will link those here as soon as I have finished.

Your wish is granted!

The libraries that are installed have an "INSTALLED" label in Library Manager. If you hover the mouse pointer over that label, it turns into an "UNINSTALL" button. Click that and the library will be deleted.

The need to improve this impossible to find and unintuitive UI is tracked here:

github.com/arduino/arduino-ide

Make Boards/Library Manager uninstall functionality easier to find

opened 04:19AM - 14 Feb 21 UTC

closed 03:17PM - 15 Mar 23 UTC

per1234

conclusion: resolved topic: code type: imperfection criticality: high

### Describe the problem I needed to uninstall a boards platform via Boards M…anager and couldn't find the <kbd>**Remove**</kbd> button I'm used to from using Arduino IDE 1.x. It took me quite some time to realize that the "**INSTALLED**" label on the entry in the list of platforms turns into an "**UNINSTALL**" button when you hover on it. ### To reproduce 1. Open the "**Boards Manager**" view. 1. Scroll down until you see the "**Arduino AVR Boards**" platform entry. 1. Look for an obvious mechanism to uninstall the platform. ### Expected behavior Make the uninstall functionality easy for the user to discover. ### Arduino IDE version #### Original report 2.0.0-beta.2-snapshot.298cc11 #### Last verified with 76f9f635d8558f399423f64c0c709e3a53bdcd03 ### Operating system All ### Operating system version Any ### Additional context A minimal change that would improve the current situation would be to change the installed "**INSTALLED**" label to have the same border and drop shadow as the <kbd>INSTALL</kbd> button. Alternatively, a <kbd>**Remove**</kbd> button could be added to mirror the Arduino IDE 1.x Boards Manager UI. --- The Arduino IDE 1.x Library Manager does not have an uninstall capability, but the Arduino IDE 1.x Boards Manager does have an uninstall capability, so the latter should be used if looking for a reference design. ### Issue checklist - [X] I searched for previous requests in [the issue tracker](https://github.com/arduino/arduino-ide/issues?q=) - [X] I verified the feature was still missing when using the latest [nightly build](https://www.arduino.cc/en/software#nightly-builds) - [X] My request contains all necessary details

There is a known defect with this system related to the subject of manual installations. If the library was installed to a folder that doesn't follow the standard Library Manager naming system, you will get an error message when you attempt to uninstall:

Library <library name> is not installed

(where <library name> is the name of the library you attempted to uninstall)

That defect is being tracked here:

github.com/arduino/arduino-cli

`name` vs `real_name` inconsistency when executing lib commands

opened 09:09AM - 02 Sep 20 UTC

closed 01:48PM - 22 Sep 22 UTC

kittaakos

conclusion: resolved topic: code type: imperfection

## Bug Report - The [`name`](https://github.com/arduino/arduino-cli/blob/ef5…7e49b6d6273653a051cfdc55bd9884f0d935a/rpc/commands/lib.proto#L220) of a library is the name of the folder in which the lib is contained: `{directories.user}/Arduino/${name}` - The [`real_name`](https://github.com/arduino/arduino-cli/blob/ef57e49b6d6273653a051cfdc55bd9884f0d935a/rpc/commands/lib.proto#L249) of a library is the human-readable name of the lib. It comes from the `library.properties`. This might be the desired behavior but it's strange. When I do a `lib search` or `lib install` the `real_name` is required, when I run a `lib list`, the `name` is required. ### Current behavior `lib search` works with `real_name`, not with `name`: ``` % ./arduino-cli lib search AllThingsTalk_LoRaWAN_SDK No libraries matching your search. Did you mean... AllThingsTalk LoRaWAN SDK % ./arduino-cli lib search "AllThingsTalk LoRaWAN SDK" Name: "AllThingsTalk LoRaWAN SDK" Author: AllThingsTalk Maintainer: Vanja <vanja@allthingstalk.com> Sentence: LoRaWAN SDK for AllThingsTalk Maker Paragraph: Compatible with Microchip RN2483 and RN2903 devices. Website: https://github.com/allthingstalk/arduino-lorawan-sdk Category: Communication Architecture: * Types: Contributed Versions: [3.0.0, 3.1.0, 3.1.2, 3.1.3, 3.1.4, 3.1.5, 3.1.6] Provides includes: AllThingsTalk_LoRaWAN.h ``` `lib install` works with `real_name` but does not work with `name`: ``` % ./arduino-cli lib install AllThingsTalk_LoRaWAN_SDK Error resolving dependencies for AllThingsTalk_LoRaWAN_SDK: looking for library: library AllThingsTalk_LoRaWAN_SDK not found % ./arduino-cli lib install "AllThingsTalk LoRaWAN SDK" AllThingsTalk LoRaWAN SDK depends on AllThingsTalk LoRaWAN SDK@3.1.6 Downloading AllThingsTalk LoRaWAN SDK@3.1.6... AllThingsTalk LoRaWAN SDK@3.1.6 already downloaded Installing AllThingsTalk LoRaWAN SDK@3.1.6... Already installed AllThingsTalk LoRaWAN SDK@3.1.6 ``` `lib list` works with `name`, but does not work with `real_name`: ``` % ./arduino-cli lib list AllThingsTalk_LoRaWAN_SDK Name Installed Available Location Description AllThingsTalk_LoRaWAN_SDK 3.1.6 - user LoRaWAN SDK for AllThingsTalk Maker % ./arduino-cli lib list "AllThingsTalk LoRaWAN SDK" No libraries installed. ``` I think this is a bug. ### Expected behavior All lib commands work either with both `name` and `real_name` or all require either the `name` or `real_name`. ### Environment - CLI version (output of `arduino-cli version`): `arduino-cli Version: 0.13.0-rc1 Commit: ef57e49` - OS and platform: macOS Catalina (`10.15.6 (19G2021)`) ### Additional context

As long as the library is installed under its standardized folder name, the uninstall capability works fine. So it is already fully functional for libraries installed via Library Manager.

ptillisch · September 8, 2022, 10:06pm

There is already one in the advanced settings:

Press the Ctrl+Shift+P keyboard shortcut (Command+Shift+P for macOS users) to open the "Command Palette".
Select the "Preferences: Open Settings (UI)" command from the menu.
A "Preferences" tab will now open. Type arduino.checkForUpdates in the "Search Settings" field.
Uncheck the box under the "Check For Updates" setting.
Click the X icon on the "Preferences" tab to close it.

KurtE · September 8, 2022, 10:38pm

Thanks for the clarifications.

Feels like it is working differently than what at least used to happen with Arduino 1.x
But who knows maybe that changed a while ago as well.

I know some things have changed like I used to get libraries installed with names like:

Where the highlighted one is: Adafruit_BusIO

I also remember reading a few years or more ago, about once you install a library you could not get rid of it. That the list of installed libraries was stored in some binary file or the like.

But that is probably several versions ago.

Thanks again

ptillisch · September 9, 2022, 3:12am

I think the way Arduino IDE 1.x does library installations is something like this:

Library archive is downloaded to Arduino15/staging/libraries
Library archive is extracted to a folder with a randomized name like arduino_139918 under <sketchbook folder>/libraries
If the target library installation location already exists, it is deleted
The extraction folder is renamed to the target library installation folder name

So if something went wrong during steps 3 or 4, you ended up with the library installation under this randomized folder name, with either another copy of the library under the expected folder, or else with an empty folder there.

Steps 3 or 4 could fail if there was a lock on a file or folder from the target folder due to having it open in another application. It might also be caused by antivirus software's "on-access"/"real--time" scanning interfering with the process.

Arduino CLI/Arduino IDE 2.x have a similar process, but there is a cleanup mechanism for the extraction folder.

For example:

$ tree -A -F -L 2 ~/Documents/Arduino/libraries/
C:/Users/per/Documents/Arduino/libraries/
└── Arduino_SigFox_for_MKRFox1200/
    ├── examples/
    ├── keywords.txt
    ├── library.properties
    └── src/

3 directories, 2 files

Now if I open the C:/Users/per/Documents/Arduino/libraries/Arduino_SigFox_for_MKRFox1200 folder and then try to upgrade the library, I get this:

$ arduino-cli lib upgrade "Arduino SigFox for MKRFox1200"
Downloading Arduino SigFox for MKRFox1200@1.0.4...
Arduino SigFox for MKRFox1200@1.0.4 already downloaded
Installing Arduino SigFox for MKRFox1200@1.0.4...
Replacing Arduino_SigFox_for_MKRFox1200@1.0.3 with Arduino SigFox for MKRFox1200@1.0.4...
Error upgrading libraries: Library install failed: moving extracted archive to destination dir: rename C:\Users\per\Documents\Arduino\libraries\package-1013994826\Arduino_SigFox_for_MKRFox1200-1.0.4 C:\Users\per\Documents\Arduino\libraries\Arduino_SigFox_for_MKRFox1200: Access is denied.

$ tree -A -F -L 2 ~/Documents/Arduino/libraries/
C:/Users/per/Documents/Arduino/libraries/
└── Arduino_SigFox_for_MKRFox1200/

1 directory, 0 files

Notice that, although the extraction was done at C:\Users\per\Documents\Arduino\libraries\package-1013994826\Arduino_SigFox_for_MKRFox1200-1.0.4, that folder was not left behind after the failed upgrade. I am left only with an empty folder where ""Arduino SigFox for MKRFox1200"@1.0.3 was previously installed.

If I try the same with Arduino IDE 1.8.19, I am left with this instead:

$ tree -A -F -L 2 ~/Documents/Arduino/libraries/
C:/Users/per/Documents/Arduino/libraries/
├── Arduino_SigFox_for_MKRFox1200/
└── arduino_389810/
    ├── examples/
    ├── keywords.txt
    ├── library.properties
    └── src/

4 directories, 2 files

Unlike Arduino IDE 2.x, Arduino IDE 1.x does not provide any interface for uninstalling libraries:

No, nothing like that. The GUI simply doesn't provide the capability. You could always manually delete the library folder if you wanted to remove it.

Maybe Teensyduino works differently. I actually don't have a lot of knowledge about the differences between Teensyduino and Arduino IDE 1.x.

ptillisch · September 9, 2022, 3:47am

I have now published the reports:

github.com/arduino/arduino-cli

Library Manager commands can produce redundant installations

opened 12:55AM - 09 Sep 22 UTC

closed 01:47PM - 22 Sep 22 UTC

per1234

conclusion: resolved topic: code type: imperfection

### Describe the problem Libraries are identified by the "real name" defined …in the `name` field of [the `library.properties` metadata file](https://arduino.github.io/arduino-cli/dev/library-specification/#libraryproperties-file-format) (or by the folder name in the case of a "legacy"/"1.0 format" library that doesn't have a metadata file). During the implementation of the Arduino Library Manager system, an unfortunate decision was made to reuse the user's library folder (`<directories.data/libraries` or `LIBRARY_LOCATION_USER`). This can be problematic because the set of libraries recognized by Library Manager include those installed by the user via alternative methods: - [manually](https://docs.arduino.cc/software/ide-v1/tutorials/installing-libraries#manual-installation) - [`arduino-cli lib install --git-url`](https://arduino.github.io/arduino-cli/dev/commands/arduino-cli_lib_install/#options) - [`arduino-cli lib install --zip-file`](https://arduino.github.io/arduino-cli/dev/commands/arduino-cli_lib_install/#options) Libraries installed via [`arduino-cli lib install`](https://arduino.github.io/arduino-cli/dev/commands/arduino-cli_lib_install) are always installed to a folder named by "sanitizing" the "real name". However, installations of a library made via other methods can have any arbitrary folder name. 🐛 If a library was installed to a folder with a name different from the sanitized "real name", the Library Manager commands that install a library generate a separate installation of the library. This means that multiple libraries with the same identifier are installed in `LIBRARY_LOCATION_USER`, which breaks some of the Library Manager capabilities. ### To reproduce #### `lib install` demo ```text $ arduino-cli version arduino-cli.exe Version: git-snapshot Commit: 3cd782d6 Date: 2022-09-07T19:10:31Z $ export ARDUINO_DIRECTORIES_USER="/tmp/arduino-cli-directories/user" $ export ARDUINO_LIBRARY_ENABLE_UNSAFE_INSTALL="true" $ arduino-cli lib install --git-url https://github.com/arduino-libraries/SigFox --git-url and --zip-path flags allow installing untrusted files, use it at your own risk. Enumerating objects: 86, done. Counting objects: 100% (86/86), done. Compressing objects: 100% (62/62), done. Total 86 (delta 30), reused 64 (delta 20), pack-reused 0 Library installed $ ls "$ARDUINO_DIRECTORIES_USER/libraries" SigFox/ $ arduino-cli lib list Name Installed Available Location Description Arduino SigFox for MKRFox1200 1.0.5 - LIBRARY_LOCATION_USER - $ arduino-cli lib install "Arduino SigFox for MKRFox1200" Downloading Arduino SigFox for MKRFox1200@1.0.4... Arduino SigFox for MKRFox1200@1.0.4 already downloaded Installing Arduino SigFox for MKRFox1200@1.0.4... Installed Arduino SigFox for MKRFox1200@1.0.4 $ ls "$ARDUINO_DIRECTORIES_USER/libraries" Arduino_SigFox_for_MKRFox1200/ SigFox/ $ arduino-cli lib list Name Installed Available Location Description Arduino SigFox for MKRFox1200 1.0.4 - LIBRARY_LOCATION_USER - " 1.0.5 - LIBRARY_LOCATION_USER - ``` 🐛 There are now two "**Arduino SigFox for MKRFox1200**" libraries installed in `LIBRARY_LOCATION_USER`. It is impossible for some Library Manager commands to operate correctly under these conditions. #### `lib upgrade` demo ```text $ arduino-cli version arduino-cli.exe Version: git-snapshot Commit: 3cd782d6 Date: 2022-09-07T19:10:31Z $ export ARDUINO_DIRECTORIES_USER="/tmp/arduino-cli-directories/user" $ export ARDUINO_LIBRARY_ENABLE_UNSAFE_INSTALL="true" $ arduino-cli lib install --git-url https://github.com/arduino-libraries/SigFox#1.0.3 # install outdated version of library --git-url and --zip-path flags allow installing untrusted files, use it at your own risk. Enumerating objects: 86, done. Counting objects: 100% (86/86), done. Compressing objects: 100% (62/62), done. Total 86 (delta 30), reused 64 (delta 20), pack-reused 0 Library installed $ ls "$ARDUINO_DIRECTORIES_USER/libraries" SigFox/ $ arduino-cli lib list Name Installed Available Location Description Arduino SigFox for MKRFox1200 1.0.5 - LIBRARY_LOCATION_USER - $ arduino-cli lib upgrade "Arduino SigFox for MKRFox1200" Downloading Arduino SigFox for MKRFox1200@1.0.4... Arduino SigFox for MKRFox1200@1.0.4 already downloaded Installing Arduino SigFox for MKRFox1200@1.0.4... Installed Arduino SigFox for MKRFox1200@1.0.4 $ ls "$ARDUINO_DIRECTORIES_USER/libraries" Arduino_SigFox_for_MKRFox1200/ SigFox/ $ arduino-cli lib list Name Installed Available Location Description Arduino SigFox for MKRFox1200 1.0.4 - LIBRARY_LOCATION_USER - " 1.0.3 1.0.4 LIBRARY_LOCATION_USER Helper library for MKRFox1200 board a... ``` 🐛 There are now two "**Arduino SigFox for MKRFox1200**" libraries installed in `LIBRARY_LOCATION_USER`. It is impossible for some Library Manager commands to operate correctly under these conditions. ### Expected behavior `arduino-cli lib` commands must never result in multiple libraries with the same identifier being installed in `LIBRARY_LOCATION_USER`. They should use one of the following approaches: Remove previous installation after installing to a new folder name. **OR** Update in place, using the folder name of the existing library. ### Arduino CLI version 3cd782d6 ### Operating system Windows, Ubuntu ### Operating system version Windows 10, Ubuntu 20.04 ### Additional context This produces the conditions for https://github.com/arduino/arduino-cli/issues/1871 ### Issue checklist - [X] I searched for previous reports in [the issue tracker](https://github.com/arduino/arduino-cli/issues?q=) - [X] I verified the problem still occurs when using the [nightly build](https://arduino.github.io/arduino-cli/dev/installation/#nightly-builds) - [X] My report contains all necessary details

github.com/arduino/arduino-cli

Multiple installations cause library to be perpetually updatable

opened 01:30AM - 09 Sep 22 UTC

closed 11:39AM - 29 Nov 22 UTC

per1234

topic: code type: imperfection

### Describe the problem Libraries are identified by the "real name" defined …in the `name` field of [the `library.properties` metadata file](https://arduino.github.io/arduino-cli/dev/library-specification/#libraryproperties-file-format) (or by the folder name in the case of a "legacy"/"1.0 format" library that doesn't have a metadata file). During the implementation of the Arduino Library Manager system, the unfortunate choice was made to reusing the user's library folder (`<directories.data/libraries` or `LIBRARY_LOCATION_USER`) instead of using a dedicated folder for Library Manager. This can be problematic because the set of libraries recognized by Library Manager include those installed by the user via alternative methods: - [manually](https://docs.arduino.cc/software/ide-v1/tutorials/installing-libraries#manual-installation) - [`arduino-cli lib install --git-url`](https://arduino.github.io/arduino-cli/dev/commands/arduino-cli_lib_install/#options) - [`arduino-cli lib install --zip-file`](https://arduino.github.io/arduino-cli/dev/commands/arduino-cli_lib_install/#options). Libraries installed via [`arduino-cli lib install`](https://arduino.github.io/arduino-cli/dev/commands/arduino-cli_lib_install) are always installed to a folder named by "sanitizing" the "real name". However, installations of a library made via other methods can have any arbitrary folder name. This means that it is possible for multiple libraries with the same identifier to be installed in `LIBRARY_LOCATION_USER`. 🐛 If multiple libraries with the same identifier are installed in `LIBRARY_LOCATION_USER`, and one has an outdated version, the library is always shown as updatable. ### To reproduce ```text $ arduino-cli version arduino-cli.exe Version: git-snapshot Commit: 3cd782d6 Date: 2022-09-07T19:10:31Z $ export ARDUINO_DIRECTORIES_USER="/tmp/arduino-cli-directories/user" $ arduino-cli lib install "Arduino SigFox for MKRFox1200" Downloading Arduino SigFox for MKRFox1200@1.0.4... Arduino SigFox for MKRFox1200@1.0.4 already downloaded Installing Arduino SigFox for MKRFox1200@1.0.4... Installed Arduino SigFox for MKRFox1200@1.0.4 $ export ARDUINO_LIBRARY_ENABLE_UNSAFE_INSTALL="true" $ arduino-cli lib install --git-url https://github.com/arduino-libraries/SigFox#1.0.3 --git-url and --zip-path flags allow installing untrusted files, use it at your own risk. Enumerating objects: 86, done. Counting objects: 100% (86/86), done. Compressing objects: 100% (62/62), done. Total 86 (delta 30), reused 64 (delta 20), pack-reused 0 Library installed $ ls "$ARDUINO_DIRECTORIES_USER/libraries" Arduino_SigFox_for_MKRFox1200/ SigFox/ $ arduino-cli lib list Name Installed Available Location Description Name Installed Available Location Description Arduino SigFox for MKRFox1200 1.0.4 - LIBRARY_LOCATION_USER - " 1.0.3 1.0.4 LIBRARY_LOCATION_USER Helper library for MKRFox1200 board a... $ arduino-cli lib list --updatable Name Installed Available Location Description Arduino SigFox for MKRFox1200 1.0.3 1.0.4 LIBRARY_LOCATION_USER Helper library for MKRFox1200 board a... $ arduino-cli lib upgrade "Arduino SigFox for MKRFox1200" Downloading Arduino SigFox for MKRFox1200@1.0.4... Arduino SigFox for MKRFox1200@1.0.4 already downloaded Installing Arduino SigFox for MKRFox1200@1.0.4... Already installed Arduino SigFox for MKRFox1200@1.0.4 $ arduino-cli lib list --updatable Name Installed Available Location Description Arduino SigFox for MKRFox1200 1.0.3 1.0.4 LIBRARY_LOCATION_USER Helper library for MKRFox1200 board a... ``` 🐛 The library is listed as updatable even after attempting to upgrade it. ### Expected behavior I don't see that there is any good way for the Library Manager functionality to support multiple libraries with the same identifier in `LIBRARY_LOCATION_USER`. The only feasible resolution is to prohibit this. Any operation that alters library installations should error if multiple installations of the library are present in `LIBRARY_LOCATION_USER`. The error message should clearly explain the problem to the user as well as the resolution of manually removing one of the redundant installations. These are the commands which require this change: - `lib upgrade` - `lib install` - `lib uninstall` ### Arduino CLI version 3cd782d6 ### Operating system Windows, Ubuntu ### Operating system version Windows 10, Ubuntu 20.04 ### Additional context A bug in Arduino CLI can cause it to produce these conditions: https://github.com/arduino/arduino-cli/issues/1870 However, the conditions can still occur even after that bug is fixed because users can still produce multiple installations via manual installations. --- Reports: - https://forum.arduino.cc/t/arduino-ide-2-0-1-is-now-available/1046764/9 --- There is currently a bug which may be inadvertently mitigating the effects of multiple installations: https://github.com/arduino/arduino-cli/issues/932 Once that bug is fixed, it is likely other commands will also be broken under these conditions. ### Issue checklist - [X] I searched for previous reports in [the issue tracker](https://github.com/arduino/arduino-cli/issues?q=) - [X] I verified the problem still occurs when using the [nightly build](https://arduino.github.io/arduino-cli/dev/installation/#nightly-builds) - [X] My report contains all necessary details

This is all in terms of Arduino CLI (since that is the origin of the defects). I'll provide a demo of the issue using the Arduino IDE interface in case that makes it easier to understand for those who are more familiar with the IDE than Arduino CLI:

Download the ZIP file of an outdated version of the "Arduino SigFox for MKRFox1200" library: https://github.com/arduino-libraries/SigFox/archive/refs/tags/1.0.3.zip
Select Sketch > Include Library > Add ZIP Library... from the Arduino IDE menus.
Select the downloaded file (SigFox-1.0.3.zip).
Click the Open button.
Use the Arduino IDE Library Manager to install the latest version of the "Arduino SigFox for MKRFox1200" library.
Select File > Quit from the Arduino IDE menus.
Start the Arduino IDE.
Click the INSTALL MANUALLY button on the "Updates are available for some of your libraries." notification.

The "Arduino SigFox for MKRFox1200" library is shown as updatable, even though you just installed the latest version via Library Manager.

Hover the mouse pointer over the "Arduino SigFox for MKRFox1200" library entry in Library Manager.
Click the "INSTALL" button

The "Output" view says "Already installed Arduino SigFox for MKRFox1200@1.0.4", but Library Manager continues to show that the library is updatable and that 1.0.3 is installed.

Willem43 · September 9, 2022, 9:26am

@ptillisch thanks for that. I suspected something might be available in the advanced settings but where amongst the multitude of available option to find it. Now disabled.

ptillisch · September 10, 2022, 10:25pm

You are welcome.

There are an overwhelming number of settings in this advanced settings interface. I most often use a default-ish configuration of the Arduino IDE since that is what the average user will have, but I configure VS Code as I like and I remember it was quite a project working through all the settings when I first migrated from using Notepad++ to VS Code as my general purpose text editor.

If you are ever looking for an Arduino-specific setting such as Library Manager updates, use the sidebar to navigate to the Extensions > Arduino section of the settings (the Arduino IDE is implemented as an extension installed in an Eclipse Theia application). All the Arduino-specific settings are found there, so this reduces the number of settings to search through.

Willem43 · September 11, 2022, 9:47am

@ptillisch Thanks for the advice.

Something a bit unrelated. Quite a long time ago I mentioned that the "hover: delay" is not sticking when changed - it only persist for the current session while the new value is actually retained, needing a reset before changing again.

It is still not working. I would like it to be a bit longer (1200) than the default 300 so as to allow me to position the cursor, and possibly click, before the information popup shows. I do want the popup, it is extremely useful, but it needs to be delayed a bit longer, at least for me.

Any possible work around?

ptillisch · September 18, 2022, 1:35am

This bug is tracked by the Arduino IDE developers here:

github.com/arduino/arduino-ide

`editor.hover.delay` setting not used by new windows

opened 03:15PM - 22 Oct 21 UTC

closed 08:39AM - 29 Nov 22 UTC

per1234

priority: low conclusion: resolved topic: code type: imperfection topic: theia criticality: medium

### Describe the problem When the mouse pointer is hovered over a code item, …a pop up called the "editor hover" appears that provides information supplied by the language server about that item: ![image](https://user-images.githubusercontent.com/8572152/138479252-253cc6ee-d806-49f7-b3bc-705a0ab3dbb3.png) The "editor hover" appears after a delay. The timing of this delay is critical to the user experience of the IDE. Too short of a delay will result in distracting unintentional appearances of the hover caused by the mouse pointer passing over random bits of code. Too long of a delay will make the hover annoyingly unresponsive. The appropriate delay duration is subjective and the default 300 ms will not be to the liking of some users. This can be adjusted according to their preference via the `editor.hover.delay` setting in the IDE's [advanced settings](https://github.com/arduino/arduino-ide/blob/main/docs/advanced-usage.md#advanced-settings). 🐛 The `editor.hover.delay` configuration setting is not used to determine hover delay duration after opening a new IDE window. ### To reproduce 1. Start the Arduino IDE. 1. Set a custom `editor.hover.delay` value in `~/.arduinoIDE/settings.json` and save the file. For example, to set the delay to 5000 ms: ```json { "editor.hover.delay": 5000 } ``` 1. Select a board supported by [the Arduino Language Server](https://github.com/arduino/arduino-language-server) from the **Tools > Board** menu (e.g., Arduino Uno). 1. Open a sketch that contains code that will produce a hover: ```cpp void setup() {} void loop() {} ``` 1. Wait for the building and indexing processes (indicated at the bottom right corner of the Arduino IDE window) to finish. 1. Hover the mouse pointer over the relevant code (e.g., the `setup` in the demo sketch above) and wait for the hover UI element to appear. 🙂 The delay between the start of hovering the mouse pointer over the code and the appearance of the hover UI element matches the custom `editor.hover.delay` setting. 1. Select **File > New** from the Arduino IDE menus. Note: the issue is not specific to **File > New**. It occurs any time a new window is opened, including when opening existing sketches or restarting the IDE. 1. Repeat steps 3-6. 🐛 This time the hover delay is the default 300 ms rather than the expected custom duration. ### Expected behavior Hover delay duration is always according by the `editor.hover.delay` setting. ### Arduino IDE version #### Original report 2.0.0-beta.12-nightly.20211021 #### Last verified with 2.0.1-snapshot-96cf09d ### Operating system Windows, Linux ### Operating system version Windows 10, Ubuntu 20.04 ## Additional context The same bug also occurs with the `editor.scrollbar.scrollByPage` and `editor.find.addExtraSpaceOnTop` settings. The bug does not occur with the `editor.autoClosingBrackets` and `editor.dragAndDrop` settings. I did not do a comprehensive survey, but I note the keys of affected settings have three levels while the unaffected have two levels. --- I can reproduce the bug in [**Theia Blueprint**](https://theia-ide.org/docs/blueprint_download) 1.25.0 (the version of Theia currently used by Arduino IDE) and 1.29.0 (the latest version). I can not reproduce the bug in VS Code. --- Originally reported at https://forum.arduino.cc/t/issues-with-pop-up-info/698527/6 ### Issue checklist - [X] I searched for previous requests in [the issue tracker](https://github.com/arduino/arduino-ide/issues?q=) - [X] I verified the feature was still missing when using the latest [nightly build](https://github.com/arduino/arduino-ide#nightly-builds) - [X] My request contains all necessary details

I verified that it still occurs with the latest version of the IDE.

Some new information: it also occurs when using the Theia Blueprint demonstration application for the Eclipse Theia IDE framework the Arduino IDE is built on. I can not reproduce the bug in VS Code. This means it is a bug in the Theia codebase rather than in the Arduino IDE or VS Code codebases (Theia is based on VS Code).

I did a bit of tinkering around and didn't find one.

Willem43 · September 18, 2022, 8:46am

@ptillisch thanks for the reply. I am aware of the tracking and am keeping an eye on it.

Pity the problem is not in the IDE where it would be relatively straightforward to fix.

This currently is my only major pain. The hover is hugely helpful for quickly checking function variable types or initialised values, so not really an option to disable. With the hover popping up so quickly it is sometimes difficult to update code.

Thanks for checking.

KurtE · September 18, 2022, 2:06pm

@ptillisch - I opened a new issue up on update manager wanting to update libraries when it clearly did not install the library.

IDE 2 - Library Manager - Should not update Library linked in and/or which is a git clone · Issue #1459 · arduino/arduino-ide (github.com)

Specifically - I wish that the IDE2 would not include in it's updatable list, that is shown when the IDE checks for updatable libraries, any library directory it sees that contain git files, like on windows a .git directory.

Yesterday I experimented a couple of times, where I have a git version that I am using.
Note: I typically keep all of my github projects contained in one place: d:\github and I make
symbolic links to them in places like the /libraries folder.
(Windows 11 I do this with command like: mklink /J SDFat d:\github\SDFat

A couple of times, I tried an update of a library which I knew was a junction to my github project.
These did have a lower version number.

The first try Arduino I believe tried to do something like: download the updated zip file, unzip it to a new directory, then try to rename the directory to the actual name. It also does something to the older version.

The first try errored out saying it could not rename the directory (access denied). I then went and looked and neither the temporary directory existed, nor the junction to the github version.
Trying update again succeeded.

I have not tried in a while on what would happen if the github project was directly within the libraries folder.

Secondary note/question? Where does the update manager get the version number of current installed from? Example:

Trying to update again (have done it several times over several days)

Looking at:


C:\Users\kurte\Documents\Arduino\libraries\Adafruit_BusIO>more library.properties
name=Adafruit BusIO
version=1.13.2
author=Adafruit
maintainer=Adafruit <info@adafruit.com>
sentence=This is a library for abstracting away UART, I2C and SPI interfacing
paragraph=This is a library for abstracting away UART, I2C and SPI interfacing
category=Signal Input/Output
url=https://github.com/adafruit/Adafruit_BusIO
architectures=*

Note: In this case it is a normal library install...

ptillisch · September 18, 2022, 6:56pm

I think it is a good suggestion. Due to the same folder being used for both the manually installed and the Library Manager installed libraries, there is no mechanism to identify which libraries were installed via Library Manager. However, the presence of a Git repository is a guarantee that a library was not installed via Library Manager, since the Library Manager system does not distribute the Git repository for the sake of efficiency.

It gets it from the version field of the library.properties metadata file.

It sounds like this bug:

github.com/arduino/arduino-cli

Multiple installations cause library to be perpetually updatable

opened 01:30AM - 09 Sep 22 UTC

closed 11:39AM - 29 Nov 22 UTC

per1234

topic: code type: imperfection

### Describe the problem Libraries are identified by the "real name" defined …in the `name` field of [the `library.properties` metadata file](https://arduino.github.io/arduino-cli/dev/library-specification/#libraryproperties-file-format) (or by the folder name in the case of a "legacy"/"1.0 format" library that doesn't have a metadata file). During the implementation of the Arduino Library Manager system, the unfortunate choice was made to reusing the user's library folder (`<directories.data/libraries` or `LIBRARY_LOCATION_USER`) instead of using a dedicated folder for Library Manager. This can be problematic because the set of libraries recognized by Library Manager include those installed by the user via alternative methods: - [manually](https://docs.arduino.cc/software/ide-v1/tutorials/installing-libraries#manual-installation) - [`arduino-cli lib install --git-url`](https://arduino.github.io/arduino-cli/dev/commands/arduino-cli_lib_install/#options) - [`arduino-cli lib install --zip-file`](https://arduino.github.io/arduino-cli/dev/commands/arduino-cli_lib_install/#options). Libraries installed via [`arduino-cli lib install`](https://arduino.github.io/arduino-cli/dev/commands/arduino-cli_lib_install) are always installed to a folder named by "sanitizing" the "real name". However, installations of a library made via other methods can have any arbitrary folder name. This means that it is possible for multiple libraries with the same identifier to be installed in `LIBRARY_LOCATION_USER`. 🐛 If multiple libraries with the same identifier are installed in `LIBRARY_LOCATION_USER`, and one has an outdated version, the library is always shown as updatable. ### To reproduce ```text $ arduino-cli version arduino-cli.exe Version: git-snapshot Commit: 3cd782d6 Date: 2022-09-07T19:10:31Z $ export ARDUINO_DIRECTORIES_USER="/tmp/arduino-cli-directories/user" $ arduino-cli lib install "Arduino SigFox for MKRFox1200" Downloading Arduino SigFox for MKRFox1200@1.0.4... Arduino SigFox for MKRFox1200@1.0.4 already downloaded Installing Arduino SigFox for MKRFox1200@1.0.4... Installed Arduino SigFox for MKRFox1200@1.0.4 $ export ARDUINO_LIBRARY_ENABLE_UNSAFE_INSTALL="true" $ arduino-cli lib install --git-url https://github.com/arduino-libraries/SigFox#1.0.3 --git-url and --zip-path flags allow installing untrusted files, use it at your own risk. Enumerating objects: 86, done. Counting objects: 100% (86/86), done. Compressing objects: 100% (62/62), done. Total 86 (delta 30), reused 64 (delta 20), pack-reused 0 Library installed $ ls "$ARDUINO_DIRECTORIES_USER/libraries" Arduino_SigFox_for_MKRFox1200/ SigFox/ $ arduino-cli lib list Name Installed Available Location Description Name Installed Available Location Description Arduino SigFox for MKRFox1200 1.0.4 - LIBRARY_LOCATION_USER - " 1.0.3 1.0.4 LIBRARY_LOCATION_USER Helper library for MKRFox1200 board a... $ arduino-cli lib list --updatable Name Installed Available Location Description Arduino SigFox for MKRFox1200 1.0.3 1.0.4 LIBRARY_LOCATION_USER Helper library for MKRFox1200 board a... $ arduino-cli lib upgrade "Arduino SigFox for MKRFox1200" Downloading Arduino SigFox for MKRFox1200@1.0.4... Arduino SigFox for MKRFox1200@1.0.4 already downloaded Installing Arduino SigFox for MKRFox1200@1.0.4... Already installed Arduino SigFox for MKRFox1200@1.0.4 $ arduino-cli lib list --updatable Name Installed Available Location Description Arduino SigFox for MKRFox1200 1.0.3 1.0.4 LIBRARY_LOCATION_USER Helper library for MKRFox1200 board a... ``` 🐛 The library is listed as updatable even after attempting to upgrade it. ### Expected behavior I don't see that there is any good way for the Library Manager functionality to support multiple libraries with the same identifier in `LIBRARY_LOCATION_USER`. The only feasible resolution is to prohibit this. Any operation that alters library installations should error if multiple installations of the library are present in `LIBRARY_LOCATION_USER`. The error message should clearly explain the problem to the user as well as the resolution of manually removing one of the redundant installations. These are the commands which require this change: - `lib upgrade` - `lib install` - `lib uninstall` ### Arduino CLI version 3cd782d6 ### Operating system Windows, Ubuntu ### Operating system version Windows 10, Ubuntu 20.04 ### Additional context A bug in Arduino CLI can cause it to produce these conditions: https://github.com/arduino/arduino-cli/issues/1870 However, the conditions can still occur even after that bug is fixed because users can still produce multiple installations via manual installations. --- Reports: - https://forum.arduino.cc/t/arduino-ide-2-0-1-is-now-available/1046764/9 --- There is currently a bug which may be inadvertently mitigating the effects of multiple installations: https://github.com/arduino/arduino-cli/issues/932 Once that bug is fixed, it is likely other commands will also be broken under these conditions. ### Issue checklist - [X] I searched for previous reports in [the issue tracker](https://github.com/arduino/arduino-cli/issues?q=) - [X] I verified the problem still occurs when using the [nightly build](https://arduino.github.io/arduino-cli/dev/installation/#nightly-builds) - [X] My report contains all necessary details

Do a search of the libraries folder to see if any of the other library.properties files contain the string:

name=Adafruit BusIO

It might be in one of the folders with a randomized temporary name something like arduino_345456 that Arduino IDE 1.x used to create sometimes if a library installation could not be completed successfully.

KurtE · September 18, 2022, 7:02pm

ptillisch:

Do a search of the libraries folder to see if any of the other library.properties files contain the string:
name=Adafruit BusIO
It might be in one of the folders with a randomized temporary name something like arduino_345456 that Arduino IDE 1.x used to create sometimes if a library installation could not be completed successfully.

Good guess

system · March 17, 2023, 7:02pm

This topic was automatically closed 180 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Troubles with library management in Arduino-IDE 1.8.4 IDE 1.x	6	2284	May 5, 2021
Problem with library manager IDE 1.x	10	1013	May 5, 2021
Library Manager in IDE 2.0 Beta 3 IDE 2.x	5	1040	November 2, 2021
So I have the nifty new library.. Libraries	5	1015	May 6, 2021
Contributing Boards and Libraries in 1.6.2 Libraries	13	5899	May 6, 2021

Related topics