Re: getmail is only getting about 8000 of my ~100, 000 emails in Gmail

To confirm, that was it. To be more accurate, adding

    "[Gmail]/All Mail"

to the mailboxes config makes getmail download all the emails.

On Sat, Nov 21, 2020 at 8:57 AM Behrang <[email protected]> wrote:

> Hi Charles,
>
> I followed the instructions on the Arch wiki:
>
>
> https://wiki.archlinux.org/index.php/Backup_Gmail_with_getmail#Migrating_emails,_importing_old_emails
>
> Here's my getmail configuration:
>
> # More configuration options here:
> # http://pyropus.ca/software/getmail/configuration.html
> [retriever]
> type = SimpleIMAPSSLRetriever
> server = imap.gmail.com
> mailboxes = ("Inbox", "[Gmail]/Sent Mail") # optional - leave this line
> out to just grab inbox
> username = myUsername
> password = verySecurePassword
>
> [destination]
> type = Maildir
> path = /home/hello/eMails/Gmail/
>
> [options]
> verbose = 2
> message_log = ~/.getmail/log
> delivered_to = false
> received = false
> read_all = true
>
> I deleted /home/hello/eMails/Gmail and reran the program.
>
> First, it seems to fetch all the emails in my inbox:
>
> msg  1/80 (35924 bytes) from <...> delivered to Maildir
> /home/hello/eMails/Gmail/
> msg  2/80 (21510 bytes) from <...> delivered to Maildir
> /home/hello/eMails/Gmail/
> ...
>
> It fetched all 80 messages successfully. Then it started to fetch emails
> in my Sent folder:
>
> msg    1/8312 (584 bytes) from <unknown> delivered to Maildir
> /home/hello/eMails/Gmail/
> msg    2/8312 (741 bytes) from <unknown> delivered to Maildir
> /home/hello/eMails/Gmail/
> msg    3/8312 (635 bytes) from <unknown> delivered to Maildir
> /home/hello/eMails/Gmail/
> ...
>
> Then after downloading all 8312 it stops. None of my archived and labeled
> emails are downloaded. I will try "[Gmail]\All" next time and will post
> the update here.
>
>
> On Sat, Nov 21, 2020 at 1:26 AM Charles Cazabon <
> [email protected]> wrote:
>
>> Behrang <[email protected]> wrote:
>> >
>> > After running getmail, it only downloaded about 8000 emails (8000 files
>> in
>> > the new folder).
>> >
>> > Do I have to add the "[Gmail]\All" to the:
>> >
>> >     mailboxes = ("Inbox", "[Gmail]/Sent Mail")
>> >
>> > configuration to get them all?
>>
>> Maybe?  Gmail does a bunch of things that are weird from an IMAP client's
>> point of view, and not being a Gmail user, I don't have personal
>> experience
>> with the UI.
>>
>> It's difficult to give you a proper answer because you didn't include any
>> information that would help narrow down the cause.  The output of getmail
>> when
>> you ran it would have shown how many messages getmail "saw" when it opened
>> each configured box/folder; did it get all those?  Did it emit any
>> error/warning messages?  Did it exit normally after retrieving all the
>> messages it intended to, or did it abort because of an error?  Does your
>> configuration specify retrieval of all mail or just unseen mail, and had
>> you
>> run getmail more than once?  Do you have max_messages_* or other options
>> set
>> on the retriver?  etc, etc.
>>
>> In general, if you want help with software on a mailing list, you should
>> include in your message:
>>
>> (1) what you did - exactly what command you ran including all
>> options/flags,
>> the complete contents of configuration files you used with no changes
>> except
>> obscuring passwords, any other setup you did
>>
>> (2) what you expected the software to do; what was the desired/expected
>> outcome based on (1)
>>
>> (3) what the computer/software actually did instead - the complete output
>> of
>> the program, including warnings and errors
>>
>> Charles
>> --
>> -----------------------------------------------------------------------
>> Charles Cazabon
>> GPL'ed software available at:               http://pyropus.ca/software/
>> -----------------------------------------------------------------------
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: [email protected]
>> For additional commands, e-mail: [email protected]
>>
>>
>
> --
> Best regards,
> Behrang Saeedzadeh
>


-- 
Best regards,
Behrang Saeedzadeh