Google Calendar Sync Issue (Robots.txt)
-
- Member
- Posts: 55
- Joined: Mon Oct 08, 2012 10:49 am
Re: Google Calendar Sync Issue (Robots.txt)
For what it is worth department workaround- I just created a new calendar in google calendar - SLC-Manual. Downloaded the .ics file from the lds.org link and then imported into my SLC-Manual. Come Saturday night I will delete my google calendar SLC-Manual, Create it again, download from lds.org again and import it again. I will just keep doing this as needed until issue is resolved, thus I am somewhat current for my uses anyway.
-
- Community Administrator
- Posts: 34417
- Joined: Sat Jan 20, 2007 2:53 pm
- Location: U.S.
Re: Google Calendar Sync Issue (Robots.txt)
I wonder if it's necessary to delete the calendar. Have you tried re-importing into the existing calendar?ramonc wrote:Come Saturday night I will delete my google calendar SLC-Manual, Create it again, download from lds.org again and import it again.
My primary use is to get the sync onto my Android device. Unlike iOS, Android does not have a way to do it natively. But there are apps that can be installed. One possible advantage - you can sync as fits your schedule rather than wait until Google gets around to it.
Have you searched the Help Center? Try doing a Google search and adding "site:churchofjesuschrist.org/help" to the search criteria.
So we can better help you, please edit your Profile to include your general location.
So we can better help you, please edit your Profile to include your general location.
-
- New Member
- Posts: 5
- Joined: Sun Jul 31, 2011 4:15 pm
Re: Google Calendar Sync Issue (Robots.txt)
This is a problem on Google's end. I have had this problem before, and have it now. Google is not able to communicate with the server. However, a browser can communicate with the server and download the calendar to an ics file that can be imported into the Google calendar. The questions and comments need to be directed to Google as to the sync process.
-
- Community Administrator
- Posts: 34417
- Joined: Sat Jan 20, 2007 2:53 pm
- Location: U.S.
Re: Google Calendar Sync Issue (Robots.txt)
It may be an issue of interpreting standards. Robots.txt is a file used by the site to direct web crawlers what is and is not to be indexed. (See Robots exclusion standard) The question is, should Google pay attention to Robots.txt when being directed by a specific user to retrieve an ICS file from a specific location for their own use? It's understandable that the church doesn't want Google to index everyone's calendar into their search engine, but there's no intent to block what Google does in behalf of a specific request from a user.brucejay wrote:This is a problem on Google's end. I have had this problem before, and have it now. Google is not able to communicate with the server. However, a browser can communicate with the server and download the calendar to an ics file that can be imported into the Google calendar. The questions and comments need to be directed to Google as to the sync process.
Web browsers ignore robots.txt as they are not "robots" but work as directed by the user.
Have you searched the Help Center? Try doing a Google search and adding "site:churchofjesuschrist.org/help" to the search criteria.
So we can better help you, please edit your Profile to include your general location.
So we can better help you, please edit your Profile to include your general location.
-
- New Member
- Posts: 4
- Joined: Sun Aug 24, 2014 9:46 am
Re: Google Calendar Sync Issue (Robots.txt)
So basically nothing has been resolved on this issue?
To the person who recommended to delete the "robot.txt" from the HTML. Can you be more specific about how this is done?
To the person who recommended to delete the "robot.txt" from the HTML. Can you be more specific about how this is done?
- aebrown
- Community Administrator
- Posts: 15153
- Joined: Tue Nov 27, 2007 8:48 pm
- Location: Draper, Utah
Re: Google Calendar Sync Issue (Robots.txt)
Whoever made that suggestion is a bit confused. The file robots.txt (it has an s on that "robots", by the way) is not in the HTML. It is a separate file. And since it is one file for LDS.org, you can't just remove it from the Calendar sync service without affecting more than just sync URLs.rbraithwaite1995 wrote:So basically nothing has been resolved on this issue?
To the person who recommended to delete the "robot.txt" from the HTML. Can you be more specific about how this is done?
Search engines gather the information for their search indexes by "crawling" the web using applications known as "web crawlers" or "spiders" or "robots" to find pages of content, then they put that information in indexes so that they can search for that content. The robots.txt file allows sites to tell search engines to ignore anything they find in certain parts of their site.
The robots.txt file for LDS.org can be found at https://www.lds.org/robots.txt . If you examine the file, you'll see a line that says "Disallow: /church-calendar". That means that web crawlers are supposed to ignore everything found in lds.org/church-calendar and below. So if we were only talking about web crawling, then Google would be correct in ignoring sync URLs, since they are found below lds.org/church-calendar. But reading a sync URL has nothing to do with crawling the web, so Google's Calendar application is misinterpreting the purpose of robots.txt if they read that and assume that they can't open a file from there.
-
- Community Administrator
- Posts: 34417
- Joined: Sat Jan 20, 2007 2:53 pm
- Location: U.S.
Re: Google Calendar Sync Issue (Robots.txt)
I'm not so sure. When I look up the purpose of Robots.txt, it seems to be aimed at automated processes, not just search engine web crawlers.aebrown wrote:Google's Calendar application is misinterpreting the purpose of robots.txt if they read that and assume that they can't open a file from there.
When I look for complaints about the robots.txt for Google calendar - I can find them, but they are from years ago. And thanks to the Wayback Machine we can see that the there was a change to the church's robots.txt done on Aug 13. So while we can argue standards, it was the church that made the change that broke things. The fact it hasn't been changed back makes me think there's a security issue involved.
Have you searched the Help Center? Try doing a Google search and adding "site:churchofjesuschrist.org/help" to the search criteria.
So we can better help you, please edit your Profile to include your general location.
So we can better help you, please edit your Profile to include your general location.
-
- New Member
- Posts: 5
- Joined: Mon Sep 01, 2014 1:35 pm
Re: Google Calendar Sync Issue (Robots.txt)
I have had LDS calendar/Google calendar sync issue from July or so. Today started working on it and finally recreated the link. At the first attempt of adding the new link to Google calendar I saw the mentioned robots.txt error for the first time. After that I did not see the error anymore, but no sync either. Copying the link to browser window displays an empty calendar in Firefox.
Another issue (should probably start a new thread for this, but I'm not doing it now) is that for few montyhs already I have not received any email notifications from lds calendar even though based on my settings and events added I should have.
Another issue (should probably start a new thread for this, but I'm not doing it now) is that for few montyhs already I have not received any email notifications from lds calendar even though based on my settings and events added I should have.
-
- New Member
- Posts: 5
- Joined: Mon Sep 01, 2014 1:35 pm
Re: Google Calendar Sync Issue (Robots.txt)
>> Copying the link to browser window displays an empty calendar in Firefox.
With this I mean the link for embedded calendar.
With this I mean the link for embedded calendar.
-
- Community Administrator
- Posts: 34417
- Joined: Sat Jan 20, 2007 2:53 pm
- Location: U.S.
Re: Google Calendar Sync Issue (Robots.txt)
How long did you wait? There's a 9 minute throttle on the calendar. If you try to use it within the 9 minutes, you'll get a http error (although many things won't report that to you.) In most browsers, you'll end up with nothing. Creating a new URL won't reset the timer - it's tied to your account.diidu wrote:After that I did not see the error anymore, but no sync either. Copying the link to browser window displays an empty calendar in Firefox.
It's addressed in the LDS.org calendar not sending email updates thread.diidu wrote:Another issue (should probably start a new thread for this, but I'm not doing it now) is that for few montyhs already I have not received any email notifications from lds calendar even though based on my settings and events added I should have.
Have you searched the Help Center? Try doing a Google search and adding "site:churchofjesuschrist.org/help" to the search criteria.
So we can better help you, please edit your Profile to include your general location.
So we can better help you, please edit your Profile to include your general location.