İçeriğe atla
0
  • Ders Ara
  • Ana Sayfa
  • Kategoriler
    • All Categories
      • Individual Categories
    • Gruplar
    • Okunmamış 0
    • Güncel
    • Kullanıcılar
    • Hakkımızda
    • Öğrenci Fırsatları
    • Akademik Takvim
    • CV oluşturucu
    • Erasmus+
    • IEU Timetable
    • Devamsızlık App
    • IEU GPA Hesaplayıcı
    • Niki Cüzdan
    • Ders Ara
    • Ana Sayfa
    • Kategoriler
      • All Categories
        • Individual Categories
      • Gruplar
      • 0 Okunmamış 0
      • Güncel
      • Kullanıcılar
      • Hakkımızda
      • Öğrenci Fırsatları
      • Akademik Takvim
      • CV oluşturucu
      • Erasmus+
      • IEU Timetable
      • Devamsızlık App
      • IEU GPA Hesaplayıcı
      • Niki Cüzdan
      Daralt
      IEU Forum – İzmir Ekonomi Üniversitesi Öğrenci Topluluğu Platformu

      IEU Forum

      -- çevrimiçi
      1. Ana Sayfa
      2. Selfhosted
      3. The Nightmare of Migrating from Lightroom CC to Immich [Adobe doesn't make it easy]

      Final Unicourse'tan Çalış, Yüksek Notu Garantile!

      %25 İndirim Kodu: FRM25
      Yükleniyor...
      Dersi İzle
      GÖRÜNTÜLEYENLER
      +36
      Premium Özellik
      Bu konuyu kimlerin görüntülediğini görmek için Premium üyelik gerekir.
      Premium'a Geç

      Vizesine Unicourse'tan Çalış, Yüksek Notu Garantile!

      A B C D Çıkmış Sorular Formül Kağıtları Konu Anlatımı Sınav İpuçları Örnek Sınav
      Dersi İzle
      YENİ ÖZELLİK

      Bi'Öğrenci Fırsatları
      Forum'da!

      Bi'Öğrenci ile artık forum üzerinden en güncel indirimlere, anlık fırsatlara ve avantajlı tekliflere ulaşabilirsin.

      FIRSATLARI KEŞFET
      Red Bull Basement
      SPONSORLU ETKİNLİK

      Fikrini Gerçeğe Dönüştür

      Projeni dünyaya göstermek için sahne hazır. Red Bull Basement başvuruları açık.

      Başvurunu Yap

      🎉 Foruma Yeni Özellik Geldi!

      Sizin için PDF toollarını getirdik!

      İncele ve Kullan

      The Nightmare of Migrating from Lightroom CC to Immich [Adobe doesn't make it easy]

      Konu Zamanlandı Sabitlendi Kilitli Taşındı Selfhosted
      selfhosted
      4 İleti 3 Yayımlayıcılar 11 Bakış
      • En eskiden en yeniye
      • En yeniden en eskiye
      • En çok oylanan
        Cevap
        • Yeni başlık oluşturarak cevapla
        Cevaplamak için giriş yapın
        Bu başlık silindi. Sadece başlık düzenleme yetkisi olan kullanıcılar görebilir.
        • A This user is from outside of this forum
          A This user is from outside of this forum
          afk_strats@lemmy.world
          tarihinde yazdı Son düzenleyen:
          #1

          I just spent the past 2 weekends migrating from Lightroom CC with just under 1TB of photos, mostly RAWs, making up about 50,000 files. I kind of made it up as I went and I spent a lot of time testing and validating. I'm going to do a writeup here to hepefully help ayone else coming acrross this and/or in case someone has ideas.

          My Requirements:

          1. Move all photos off Lightroom and preserve both RAW files and snapshot renders at high quality. I intend on staying on Lightroom because it's my editor of choice. I've litigated Darktable in comments on Lemmy, and while I love the software and the concept, I use Lightroom for my semi-professional work
          2. (The hard part) Metadata. I absolutely need my album organization, my picks, and my star ratings from Lightroom. More on this below
          3. All data must move to my self-hosted Immich with a TrueNAS pool behind it. The stack is Proxmox running a Truenas VM and a Debain VM. The Debian VM runs docker where Immich runs. Connectivity is driven by Netbird mesh VPN. That is a limitation for sharing and I'm ok with it.

          Getting your pictures out

          • Adobe doesn't make this easy just below the surface. There are open source tools intended to help one migrate from Lighroom Classic catalogs to Immich, but CC is very different. The export options are very particular.
            • Adobe lets you export a massive dump of pictures and renders as a real export option. It's through their website and it will email you when a dump is ready. Said dump will contain multiple zip files each with RAWs and renders. NO Metada or structure is included and NO edit data.
          • You can "Archive" from Lightroom CC (tested on Mac) and that will output originals + the edit file AND it will preserve the root album from which your photo came. But no metadata beyond that (no ratings, folder structure, picks). The bad part is that this deletes your files once it's done. You can still restore fromTrash but this is definitely a hostile action against users.
          • You can just output EVERYTHING. This is for the truly insane as you sit there and wait for Lightroom to render each one of your pictures individually. If you do original + edits, that returns the same thing as Archive but without structure.
          • The secret 4th option: you can (as of this writing) parse Lightroom's internal catalog and get Albums, picks, star ratings, and folder structure. This was a massive unlock for me. This file was at ~/Library/Application Support/Adobe/Lightroom/

          My solution going forward

          Because I was discovering this as I went, I tried some version of all of the options above, but going forward, I have a process which should be much easier.

          First, I will parse the catalog which is a SQLite db and extract the newest "version" of each picture and the content I care about. I will store it in a CSV for long-term holding.

          Once metadata is stored, I'll go and request the archive through the website. That will take a few hours to possibly days (it took me about 2 hours on a Friday night). Once that's done, you get an email and a link to a personalized site. You have to parse the (for me) 50+ links and download them sequentially. It took me a few hours to download 1 TB limited by my local bandwidth (for which I'm eternally grateful). With my TrueNAS storage, I have the luxury of landing the data and uploading it to Immich separately.

          For XMPs, the edit data, you have to get that from a local source so either export originals or the desktop app "Archive All" option.

          You'll have to decide what you need and maybe you have fewer requirements than me.

          Landing the Pictures

          The next challenge is grabbing all of that data, pictures and ratings and applyhing them in Immich. Luckily, it has a fantastic API so I can script the whole thing. Most of the mapping happened by picture name and there were a few times where I had to dig into exif to identify a picture. Overall, i think I had 40 or so files out of 50k+ which couldn't be mapped.

          Encountered Problems:

          • As mentioned before, this was a try-it-until-it-works situation for me. I had to download all of my pictures 2 times by 2 different methods (I didn't document this but there was an SMB share involved).
          • Stars are a new object and I had to manually enable it in Immich
          • I couldn't replicated nested album functionality in Immich and chose to keep the root album name + a tag of the folder structure. That worked well for me
          • Lightroom tags could not be exported. I don't use them a lot but that could be a blocker for some.

          Disclaimer

          • Every word in this write up was written by me on my keyboard
          • I used a self-hosted local AI to do this work.
          • I know enough to be in control even at a technical level, but the time savings on this project with AI really made it possible
          • The AI found the catalog and parsed the data out of it. It would not have occurred to me.

          Future

          • I have all of this work on my personal Forgejo and if there's enough interest, I may post publicly, though this write-up should serve as a starting point for anyone who wants to replicate my process
          Link Preview Image
          artyom@piefed.socialA inari@piefed.zipI 2 Cevap Son cevap
          1
          • A afk_strats@lemmy.world

            I just spent the past 2 weekends migrating from Lightroom CC with just under 1TB of photos, mostly RAWs, making up about 50,000 files. I kind of made it up as I went and I spent a lot of time testing and validating. I'm going to do a writeup here to hepefully help ayone else coming acrross this and/or in case someone has ideas.

            My Requirements:

            1. Move all photos off Lightroom and preserve both RAW files and snapshot renders at high quality. I intend on staying on Lightroom because it's my editor of choice. I've litigated Darktable in comments on Lemmy, and while I love the software and the concept, I use Lightroom for my semi-professional work
            2. (The hard part) Metadata. I absolutely need my album organization, my picks, and my star ratings from Lightroom. More on this below
            3. All data must move to my self-hosted Immich with a TrueNAS pool behind it. The stack is Proxmox running a Truenas VM and a Debain VM. The Debian VM runs docker where Immich runs. Connectivity is driven by Netbird mesh VPN. That is a limitation for sharing and I'm ok with it.

            Getting your pictures out

            • Adobe doesn't make this easy just below the surface. There are open source tools intended to help one migrate from Lighroom Classic catalogs to Immich, but CC is very different. The export options are very particular.
              • Adobe lets you export a massive dump of pictures and renders as a real export option. It's through their website and it will email you when a dump is ready. Said dump will contain multiple zip files each with RAWs and renders. NO Metada or structure is included and NO edit data.
            • You can "Archive" from Lightroom CC (tested on Mac) and that will output originals + the edit file AND it will preserve the root album from which your photo came. But no metadata beyond that (no ratings, folder structure, picks). The bad part is that this deletes your files once it's done. You can still restore fromTrash but this is definitely a hostile action against users.
            • You can just output EVERYTHING. This is for the truly insane as you sit there and wait for Lightroom to render each one of your pictures individually. If you do original + edits, that returns the same thing as Archive but without structure.
            • The secret 4th option: you can (as of this writing) parse Lightroom's internal catalog and get Albums, picks, star ratings, and folder structure. This was a massive unlock for me. This file was at ~/Library/Application Support/Adobe/Lightroom/

            My solution going forward

            Because I was discovering this as I went, I tried some version of all of the options above, but going forward, I have a process which should be much easier.

            First, I will parse the catalog which is a SQLite db and extract the newest "version" of each picture and the content I care about. I will store it in a CSV for long-term holding.

            Once metadata is stored, I'll go and request the archive through the website. That will take a few hours to possibly days (it took me about 2 hours on a Friday night). Once that's done, you get an email and a link to a personalized site. You have to parse the (for me) 50+ links and download them sequentially. It took me a few hours to download 1 TB limited by my local bandwidth (for which I'm eternally grateful). With my TrueNAS storage, I have the luxury of landing the data and uploading it to Immich separately.

            For XMPs, the edit data, you have to get that from a local source so either export originals or the desktop app "Archive All" option.

            You'll have to decide what you need and maybe you have fewer requirements than me.

            Landing the Pictures

            The next challenge is grabbing all of that data, pictures and ratings and applyhing them in Immich. Luckily, it has a fantastic API so I can script the whole thing. Most of the mapping happened by picture name and there were a few times where I had to dig into exif to identify a picture. Overall, i think I had 40 or so files out of 50k+ which couldn't be mapped.

            Encountered Problems:

            • As mentioned before, this was a try-it-until-it-works situation for me. I had to download all of my pictures 2 times by 2 different methods (I didn't document this but there was an SMB share involved).
            • Stars are a new object and I had to manually enable it in Immich
            • I couldn't replicated nested album functionality in Immich and chose to keep the root album name + a tag of the folder structure. That worked well for me
            • Lightroom tags could not be exported. I don't use them a lot but that could be a blocker for some.

            Disclaimer

            • Every word in this write up was written by me on my keyboard
            • I used a self-hosted local AI to do this work.
            • I know enough to be in control even at a technical level, but the time savings on this project with AI really made it possible
            • The AI found the catalog and parsed the data out of it. It would not have occurred to me.

            Future

            • I have all of this work on my personal Forgejo and if there's enough interest, I may post publicly, though this write-up should serve as a starting point for anyone who wants to replicate my process
            Link Preview Image
            artyom@piefed.socialA This user is from outside of this forum
            artyom@piefed.socialA This user is from outside of this forum
            artyom@piefed.social
            tarihinde yazdı Son düzenleyen:
            #2

            Yeah Google does the same. When you Takeout your photos they split the images and metadata into separate files. Bunch dicks. Fortunately Immich has solved this and knows how to merge them back together.

            A 1 Cevap Son cevap
            0
            • artyom@piefed.socialA artyom@piefed.social

              Yeah Google does the same. When you Takeout your photos they split the images and metadata into separate files. Bunch dicks. Fortunately Immich has solved this and knows how to merge them back together.

              A This user is from outside of this forum
              A This user is from outside of this forum
              afk_strats@lemmy.world
              tarihinde yazdı Son düzenleyen:
              #3

              I haven't documented this yet but I did do Google Takeout. It is just as bad and they rotate credentials every few minutes so they make it really hard to download the 80 files they output my pictures into

              Immich has built-in tooling to handle Takeout, bless them

              1 Cevap Son cevap
              0
              • A afk_strats@lemmy.world

                I just spent the past 2 weekends migrating from Lightroom CC with just under 1TB of photos, mostly RAWs, making up about 50,000 files. I kind of made it up as I went and I spent a lot of time testing and validating. I'm going to do a writeup here to hepefully help ayone else coming acrross this and/or in case someone has ideas.

                My Requirements:

                1. Move all photos off Lightroom and preserve both RAW files and snapshot renders at high quality. I intend on staying on Lightroom because it's my editor of choice. I've litigated Darktable in comments on Lemmy, and while I love the software and the concept, I use Lightroom for my semi-professional work
                2. (The hard part) Metadata. I absolutely need my album organization, my picks, and my star ratings from Lightroom. More on this below
                3. All data must move to my self-hosted Immich with a TrueNAS pool behind it. The stack is Proxmox running a Truenas VM and a Debain VM. The Debian VM runs docker where Immich runs. Connectivity is driven by Netbird mesh VPN. That is a limitation for sharing and I'm ok with it.

                Getting your pictures out

                • Adobe doesn't make this easy just below the surface. There are open source tools intended to help one migrate from Lighroom Classic catalogs to Immich, but CC is very different. The export options are very particular.
                  • Adobe lets you export a massive dump of pictures and renders as a real export option. It's through their website and it will email you when a dump is ready. Said dump will contain multiple zip files each with RAWs and renders. NO Metada or structure is included and NO edit data.
                • You can "Archive" from Lightroom CC (tested on Mac) and that will output originals + the edit file AND it will preserve the root album from which your photo came. But no metadata beyond that (no ratings, folder structure, picks). The bad part is that this deletes your files once it's done. You can still restore fromTrash but this is definitely a hostile action against users.
                • You can just output EVERYTHING. This is for the truly insane as you sit there and wait for Lightroom to render each one of your pictures individually. If you do original + edits, that returns the same thing as Archive but without structure.
                • The secret 4th option: you can (as of this writing) parse Lightroom's internal catalog and get Albums, picks, star ratings, and folder structure. This was a massive unlock for me. This file was at ~/Library/Application Support/Adobe/Lightroom/

                My solution going forward

                Because I was discovering this as I went, I tried some version of all of the options above, but going forward, I have a process which should be much easier.

                First, I will parse the catalog which is a SQLite db and extract the newest "version" of each picture and the content I care about. I will store it in a CSV for long-term holding.

                Once metadata is stored, I'll go and request the archive through the website. That will take a few hours to possibly days (it took me about 2 hours on a Friday night). Once that's done, you get an email and a link to a personalized site. You have to parse the (for me) 50+ links and download them sequentially. It took me a few hours to download 1 TB limited by my local bandwidth (for which I'm eternally grateful). With my TrueNAS storage, I have the luxury of landing the data and uploading it to Immich separately.

                For XMPs, the edit data, you have to get that from a local source so either export originals or the desktop app "Archive All" option.

                You'll have to decide what you need and maybe you have fewer requirements than me.

                Landing the Pictures

                The next challenge is grabbing all of that data, pictures and ratings and applyhing them in Immich. Luckily, it has a fantastic API so I can script the whole thing. Most of the mapping happened by picture name and there were a few times where I had to dig into exif to identify a picture. Overall, i think I had 40 or so files out of 50k+ which couldn't be mapped.

                Encountered Problems:

                • As mentioned before, this was a try-it-until-it-works situation for me. I had to download all of my pictures 2 times by 2 different methods (I didn't document this but there was an SMB share involved).
                • Stars are a new object and I had to manually enable it in Immich
                • I couldn't replicated nested album functionality in Immich and chose to keep the root album name + a tag of the folder structure. That worked well for me
                • Lightroom tags could not be exported. I don't use them a lot but that could be a blocker for some.

                Disclaimer

                • Every word in this write up was written by me on my keyboard
                • I used a self-hosted local AI to do this work.
                • I know enough to be in control even at a technical level, but the time savings on this project with AI really made it possible
                • The AI found the catalog and parsed the data out of it. It would not have occurred to me.

                Future

                • I have all of this work on my personal Forgejo and if there's enough interest, I may post publicly, though this write-up should serve as a starting point for anyone who wants to replicate my process
                Link Preview Image
                inari@piefed.zipI This user is from outside of this forum
                inari@piefed.zipI This user is from outside of this forum
                inari@piefed.zip
                tarihinde yazdı Son düzenleyen:
                #4

                Adobe: not even once

                1 Cevap Son cevap
                1

                Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                With your input, this post could be even better 💗

                Kayıt Ol Giriş
                Cevap
                • Yeni başlık oluşturarak cevapla
                Cevaplamak için giriş yapın
                • En eskiden en yeniye
                • En yeniden en eskiye
                • En çok oylanan


                  Önerilen Başlıklar

                  • S

                    Finally escaping Windows, ironically thanks to AI

                    Takip ediliyor Susturulmuş Konu Zamanlandı Sabitlendi Kilitli Taşındı Selfhosted selfhosted
                    1
                    1 Oy
                    1 İleti
                    1 Bakış
                    Kimse yanıtlamadı
                  • xelar@lemmy.mlX

                    My lil server (RasPi4+powered USB hub with 2 SSDs)

                    Takip ediliyor Susturulmuş Konu Zamanlandı Sabitlendi Kilitli Taşındı Selfhosted selfhosted
                    1
                    1
                    1 Oy
                    1 İleti
                    1 Bakış
                    Kimse yanıtlamadı
                  • S

                    Old laptop with non-funtional display... What do I turn it into

                    Takip ediliyor Susturulmuş Konu Zamanlandı Sabitlendi Kilitli Taşındı Selfhosted selfhosted
                    1
                    1 Oy
                    1 İleti
                    5 Bakış
                    Kimse yanıtlamadı
                  • A

                    Need help from users to volunteer testing of his digital wellbeing software

                    Takip ediliyor Susturulmuş Konu Zamanlandı Sabitlendi Kilitli Taşındı Selfhosted selfhosted
                    1
                    -1 Oy
                    1 İleti
                    9 Bakış
                    Kimse yanıtlamadı
                  • C

                    Any good file sync server with web interface other than Nextcloud?

                    Takip ediliyor Susturulmuş Konu Zamanlandı Sabitlendi Kilitli Taşındı Selfhosted selfhosted
                    1
                    1 Oy
                    1 İleti
                    6 Bakış
                    Kimse yanıtlamadı

                  Developed by Enes Uysal & Kadir Ay

                  9

                  Çevrimiçi

                  9.1k

                  Kullanıcı

                  2.0k

                  Konu

                  3.8k

                  İleti
                  • Giriş

                  • Hesabınız yok mu? Kayıt Ol

                  • Aramak için giriş yapın veya kaydolun
                  • İlk ileti
                    Son ileti