Unable to connect to http://step.esa.int/auxdata/orbits/Sentinel-1/POEORB/S1A/2018/01/: Read timed out

[EmileSonneveld]

Another day, an other error on CI:

WARNING: eu.esa.sar.orbits.io.sentinel1.OrbitFileScraper: Unable to connect to http://step.esa.int/auxdata/orbits/Sentinel-1/POEORB/S1A/2018/01/: Read timed out
WARNING: eu.esa.sar.orbits.io.sentinel1.OrbitFileScraper: Unable to connect to http://step.esa.int/auxdata/orbits/Sentinel-1/POEORB/S1A/2018/02/: Connect timed out
WARNING: eu.esa.sar.orbits.gpf.ApplyOrbitFileOp: No valid orbit file found for 28-JAN-2018 06:25:55.087466
Orbit files may be downloaded from Copernicus Dataspaces 
and placed in /root/.snap/auxdata/Orbits/Sentinel-1/POEORB/S1A/2018/01
WARNING: eu.esa.sar.orbits.io.sentinel1.OrbitFileScraper: Unable to connect to http://step.esa.int/auxdata/orbits/Sentinel-1/RESORB/S1A/2018/01/: Read timed out
WARNING: eu.esa.sar.orbits.io.sentinel1.OrbitFileScraper: Unable to connect to http://step.esa.int/auxdata/orbits/Sentinel-1/RESORB/S1A/2018/02/: Connect timed out
No valid orbit file found for 28-JAN-2018 06:25:55.087466
Orbit files may be downloaded from Copernicus Dataspaces 
and placed in /root/.snap/auxdata/Orbits/Sentinel-1/POEORB/S1A/2018/01
 done.
 Error: [NodeId: Apply-Orbit-File] No valid orbit file found for 28-JAN-2018 06:25:55.087466
Orbit files may be downloaded from Copernicus Dataspaces 
and placed in /root/.snap/auxdata/Orbits/Sentinel-1/POEORB/S1A/2018/01
org.esa.snap.core.gpf.graph.GraphException: [NodeId: Apply-Orbit-File] No valid orbit file found for 28-JAN-2018 06:25:55.087466
Orbit files may be downloaded from Copernicus Dataspaces 
and placed in /root/.snap/auxdata/Orbits/Sentinel-1/POEORB/S1A/2018/01
\tat org.esa.s

This will probably get solved by itself

[EmileSonneveld]

Seems like a recurring problem, that solves itself once in a while. https://senbox.atlassian.net/browse/SNAP-4111

[jdries]

Read this:
https://dataspace.copernicus.eu/news/2023-11-9-precise-orbit-determination-auxiliary-data-now-available-download-copernicus-browser
If these orbit files are on CDSE already, then we can make use of a more stable download method?

[EmileSonneveld]

Aother ocurence of an orbits request failing:

j-26050408055742cda923380a80ce91f2 logs

INFO: org.esa.snap.core.gpf.operators.tooladapter.ToolAdapterIO: Initializing external tool adapters
INFO: org.esa.snap.core.util.EngineVersionCheckActivator: Please check regularly for new updates for the best SNAP experience.
Executing processing graph
INFO: eu.esa.sar.commons.io.ImageIOFile: Using FileCacheImageInputStream
WARNING: eu.esa.sar.orbits.io.sentinel1.OrbitFileScraper: Unable to connect to http://step.esa.int/auxdata/orbits/Sentinel-1/POEORB/S1A/2018/01/: Connect timed out
WARNING: eu.esa.sar.orbits.io.sentinel1.OrbitFileScraper: Unable to connect to http://step.esa.int/auxdata/orbits/Sentinel-1/POEORB/S1A/2018/02/: Connect timed out
WARNING: eu.esa.sar.orbits.gpf.ApplyOrbitFileOp: No valid orbit file found for 28-JAN-2018 06:25:55.087466
Orbit files may be downloaded from Copernicus Dataspaces 
and placed in /home/ubuntu/.snap/auxdata/Orbits/Sentinel-1/POEORB/S1A/2018/01
WARNING: eu.esa.sar.orbits.gpf.ApplyOrbitFileOp: Using Sentinel Restituted /home/ubuntu/.snap/auxdata/Orbits/Sentinel-1/RESORB/S1A/2018/01/S1A_OPER_AUX_RESORB_OPOD_20180128T085810_V20180128T040905_20180128T072635.EOF.zip instead
INFO: eu.esa.sar.commons.io.ImageIOFile: Using FileCacheImageInputStream
WARNING: eu.esa.sar.orbits.io.sentinel1.OrbitFileScraper: Unable to connect to http://step.esa.int/auxdata/orbits/Sentinel-1/POEORB/S1B/2018/02/: Read timed out
WARNING: eu.esa.sar.orbits.io.sentinel1.OrbitFileScraper: Unable to connect to http://step.esa.int/auxdata/orbits/Sentinel-1/POEORB/S1B/2018/01/: Connect timed out
WARNING: eu.esa.sar.orbits.gpf.ApplyOrbitFileOp: No valid orbit file found for 03-FEB-2018 06:25:02.964162
Orbit files may be downloaded from Copernicus Dataspaces 
and placed in /home/ubuntu/.snap/auxdata/Orbits/Sentinel-1/POEORB/S1B/2018/02
WARNING: eu.esa.sar.orbits.io.sentinel1.OrbitFileScraper: Unable to connect to http://step.esa.int/auxdata/orbits/Sentinel-1/RESORB/S1B/2018/02/: Connect timed out
WARNING: eu.esa.sar.orbits.io.sentinel1.OrbitFileScraper: Unable to connect to http://step.esa.int/auxdata/orbits/Sentinel-1/RESORB/S1B/2018/01/: Read timed out
No valid orbit file found for 03-FEB-2018 06:25:02.964162
Orbit files may be downloaded from Copernicus Dataspaces 
and placed in /home/ubuntu/.snap/auxdata/Orbits/Sentinel-1/POEORB/S1B/2018/02
 done.

Error: [NodeId: Apply-Orbit-File(2)] No valid orbit file found for 03-FEB-2018 06:25:02.964162
Orbit files may be downloaded from Copernicus Dataspaces 
and placed in /home/ubuntu/.snap/auxdata/Orbits/Sentinel-1/POEORB/S1B/2018/02
org.esa.snap.core.gpf.graph.GraphException: [NodeId: Apply-Orbit-File(2)] No valid orbit file found for 03-FEB-2018 06:25:02.964162
Orbit files may be downloaded from Copernicus Dataspaces 
and placed in /home/ubuntu/.snap/auxdata/Orbits/Sentinel-1/POEORB/S1B/2018/02
	at org.esa.snap.core.gpf.graph.NodeContext.initTargetProduct(NodeContext.java:79)
	at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:213)
	at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:195)
	at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:195)
	at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:195)
	at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:195)
	at org.esa.snap.core.gpf.graph.GraphContext.initOutput(GraphContext.java:179)
	at org.esa.snap.core.gpf.graph.GraphContext.init(GraphContext.java:98)
	at org.esa.snap.core.gpf.graph.GraphContext.<init>(GraphContext.java:83)
	at org.esa.snap.core.gpf.graph.GraphContext.<init>(GraphContext.java:94)
	at org.esa.snap.core.gpf.graph.GraphContext.<init>(GraphContext.java:58)
	at org.esa.snap.core.gpf.graph.GraphProcessor.executeGraph(GraphProcessor.java:127)
	at org.esa.snap.core.gpf.main.DefaultCommandLineContext.executeGraph(DefaultCommandLineContext.java:115)
	at org.esa.snap.core.gpf.main.CommandLineTool.executeGraph(CommandLineTool.java:611)
	at org.esa.snap.core.gpf.main.CommandLineTool.runGraph(CommandLineTool.java:440)
	at org.esa.snap.core.gpf.main.CommandLineTool.runGraphOrOperator(CommandLineTool.java:325)
	at org.esa.snap.core.gpf.main.CommandLineTool.run(CommandLineTool.java:226)
	at org.esa.snap.core.gpf.main.CommandLineTool.run(CommandLineTool.java:131)
	at org.esa.snap.core.gpf.main.GPT.run(GPT.java:60)
	at org.esa.snap.core.gpf.main.GPT.main(GPT.java:37)
	at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
	at java.base/java.lang.reflect.Method.invoke(Method.java:580)
	at org.esa.snap.runtime.Launcher.lambda$run$0(Launcher.java:55)
	at org.esa.snap.runtime.Engine.runClientCode(Engine.java:190)
	at org.esa.snap.runtime.Launcher.run(Launcher.java:51)
	at org.esa.snap.runtime.Launcher.main(Launcher.java:31)
	at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
	at java.base/java.lang.reflect.Method.invoke(Method.java:580)
	at com.exe4j.runtime.LauncherEngine.launch(LauncherEngine.java:84)
	at com.install4j.runtime.launcher.UnixLauncher.start(UnixLauncher.java:71)
	at install4j.org.esa.snap.runtime.Launcher_gpt.main(Unknown Source)
Caused by: org.esa.snap.core.gpf.OperatorException: No valid orbit file found for 03-FEB-2018 06:25:02.964162
Orbit files may be downloaded from Copernicus Dataspaces 
and placed in /home/ubuntu/.snap/auxdata/Orbits/Sentinel-1/POEORB/S1B/2018/02
	at org.esa.snap.engine_utilities.gpf.OperatorUtils.catchOperatorException(OperatorUtils.java:434)
	at eu.esa.sar.orbits.gpf.ApplyOrbitFileOp.initialize(ApplyOrbitFileOp.java:205)
	at org.esa.snap.core.gpf.internal.OperatorContext.initializeOperator(OperatorContext.java:528)
	at org.esa.snap.core.gpf.internal.OperatorContext.getTargetProduct(OperatorContext.java:298)
	at org.esa.snap.core.gpf.Operator.getTargetProduct(Operator.java:359)
	at org.esa.snap.core.gpf.graph.NodeContext.initTargetProduct(NodeContext.java:77)
	... 30 more
Caused by: java.io.IOException: No valid orbit file found for 03-FEB-2018 06:25:02.964162
Orbit files may be downloaded from Copernicus Dataspaces 
and placed in /home/ubuntu/.snap/auxdata/Orbits/Sentinel-1/POEORB/S1B/2018/02
	at eu.esa.sar.orbits.io.sentinel1.SentinelPODOrbitFile.retrieveOrbitFile(SentinelPODOrbitFile.java:102)
	at eu.esa.sar.orbits.gpf.ApplyOrbitFileOp.updateOrbits(ApplyOrbitFileOp.java:247)
	at eu.esa.sar.orbits.gpf.ApplyOrbitFileOp.initialize(ApplyOrbitFileOp.java:193)
	... 34 more

[jdries]

@EmileSonneveld so the orbit files are on object storage, here:
/eodata/Sentinel-1/AUX/AUX_POEORB/
How hard is it to download specific ones needed for the processing, avoiding the http timeout issue?

[EmileSonneveld]

The files are structured slightly different
eodata: /eodata/Sentinel-1/AUX/AUX_POEORB/2018/01/27/S1A_OPER_AUX_POEORB_OPOD_20210306T032119_V20180127T225942_20180129T005942.EOF
SNAP: /home/emile/.snap/auxdata/Orbits/Sentinel-1/POEORB/S1A/2018/01/S1A_OPER_AUX_POEORB_OPOD_20210306T032119_V20180127T225942_20180129T005942.EOF.zip

[EmileSonneveld]

If snap would retry this call, it could already be solved: https://forum.step.esa.int/t/orbit-file-download-seems-not-retried/45780

Another ocurence of an orbits request failing:

j-2605071155054c01ab219ac3b2230e77 logs

INFO: org.esa.snap.core.gpf.operators.tooladapter.ToolAdapterIO: Initializing external tool adapters
INFO: org.esa.snap.core.util.EngineVersionCheckActivator: Please check regularly for new updates for the best SNAP experience.
WARNING: org.esa.snap.core.util.EngineVersionCheckActivator: A new SNAP version is available for download.
Currently installed 12.0.0, available is 13.0.0.
Please visit http://step.esa.int

Executing processing graph
INFO: eu.esa.sar.commons.io.ImageIOFile: Using FileCacheImageInputStream
INFO: org.esa.snap.engine_utilities.download.DownloadableContentImpl: http retrieving http://step.esa.int/auxdata/orbits/Sentinel-1/POEORB/S1A/2024/08/S1A_OPER_AUX_POEORB_OPOD_20240914T070604_V20240824T225942_20240826T005942.EOF.zip
WARNING: eu.esa.sar.orbits.io.sentinel1.OrbitFileScraper: Unable to connect to http://step.esa.int/auxdata/orbits/Sentinel-1/POEORB/S1A/2024/09/: Read timed out
WARNING: eu.esa.sar.orbits.io.sentinel1.OrbitFileScraper: Unable to connect to http://step.esa.int/auxdata/orbits/Sentinel-1/POEORB/S1A/2024/10/: Read timed out
WARNING: eu.esa.sar.orbits.gpf.ApplyOrbitFileOp: No valid orbit file found for 18-SEP-2024 05:26:03.766922
Orbit files may be downloaded from Copernicus Dataspaces 
and placed in /home/ubuntu/.snap/auxdata/Orbits/Sentinel-1/POEORB/S1A/2024/09
WARNING: eu.esa.sar.orbits.io.sentinel1.OrbitFileScraper: Unable to connect to http://step.esa.int/auxdata/orbits/Sentinel-1/RESORB/S1A/2024/09/: Read timed out
WARNING: eu.esa.sar.orbits.io.sentinel1.OrbitFileScraper: Unable to connect to http://step.esa.int/auxdata/orbits/Sentinel-1/RESORB/S1A/2024/10/: Read timed out
No valid orbit file found for 18-SEP-2024 05:26:03.766922
Orbit files may be downloaded from Copernicus Dataspaces 
and placed in /home/ubuntu/.snap/auxdata/Orbits/Sentinel-1/POEORB/S1A/2024/09
 done.

Error: [NodeId: Apply-Orbit-File(2)] No valid orbit file found for 18-SEP-2024 05:26:03.766922
Orbit files may be downloaded from Copernicus Dataspaces 
and placed in /home/ubuntu/.snap/auxdata/Orbits/Sentinel-1/POEORB/S1A/2024/09
org.esa.snap.core.gpf.graph.GraphException: [NodeId: Apply-Orbit-File(2)] No valid orbit file found for 18-SEP-2024 05:26:03.766922
Orbit files may be downloaded from Copernicus Dataspaces 
and placed in /home/ubuntu/.snap/auxdata/Orbits/Sentinel-1/POEORB/S1A/2024/09
	at org.esa.snap.core.gpf.graph.NodeContext.initTargetProduct(NodeContext.java:79)
	at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:213)
	at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:195)
	at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:195)
	at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:195)
	at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:195)
	at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:195)
	at org.esa.snap.core.gpf.graph.GraphContext.initNodeContext(GraphContext.java:195)
	at org.esa.snap.core.gpf.graph.GraphContext.initOutput(GraphContext.java:179)
	at org.esa.snap.core.gpf.graph.GraphContext.init(GraphContext.java:98)
	at org.esa.snap.core.gpf.graph.GraphContext.<init>(GraphContext.java:83)
	at org.esa.snap.core.gpf.graph.GraphContext.<init>(GraphContext.java:94)
	at org.esa.snap.core.gpf.graph.GraphContext.<init>(GraphContext.java:58)
	at org.esa.snap.core.gpf.graph.GraphProcessor.executeGraph(GraphProcessor.java:127)
	at org.esa.snap.core.gpf.main.DefaultCommandLineContext.executeGraph(DefaultCommandLineContext.java:115)
	at org.esa.snap.core.gpf.main.CommandLineTool.executeGraph(CommandLineTool.java:611)
	at org.esa.snap.core.gpf.main.CommandLineTool.runGraph(CommandLineTool.java:440)
	at org.esa.snap.core.gpf.main.CommandLineTool.runGraphOrOperator(CommandLineTool.java:325)
	at org.esa.snap.core.gpf.main.CommandLineTool.run(CommandLineTool.java:226)
	at org.esa.snap.core.gpf.main.CommandLineTool.run(CommandLineTool.java:131)
	at org.esa.snap.core.gpf.main.GPT.run(GPT.java:60)
	at org.esa.snap.core.gpf.main.GPT.main(GPT.java:37)
	at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
	at java.base/java.lang.reflect.Method.invoke(Method.java:580)
	at org.esa.snap.runtime.Launcher.lambda$run$0(Launcher.java:55)
	at org.esa.snap.runtime.Engine.runClientCode(Engine.java:190)
	at org.esa.snap.runtime.Launcher.run(Launcher.java:51)
	at org.esa.snap.runtime.Launcher.main(Launcher.java:31)
	at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
	at java.base/java.lang.reflect.Method.invoke(Method.java:580)
	at com.exe4j.runtime.LauncherEngine.launch(LauncherEngine.java:84)
	at com.install4j.runtime.launcher.UnixLauncher.start(UnixLauncher.java:71)
	at install4j.org.esa.snap.runtime.Launcher_gpt.main(Unknown Source)
Caused by: org.esa.snap.core.gpf.OperatorException: No valid orbit file found for 18-SEP-2024 05:26:03.766922
Orbit files may be downloaded from Copernicus Dataspaces 
and placed in /home/ubuntu/.snap/auxdata/Orbits/Sentinel-1/POEORB/S1A/2024/09
	at org.esa.snap.engine_utilities.gpf.OperatorUtils.catchOperatorException(OperatorUtils.java:434)
	at eu.esa.sar.orbits.gpf.ApplyOrbitFileOp.initialize(ApplyOrbitFileOp.java:205)
	at org.esa.snap.core.gpf.internal.OperatorContext.initializeOperator(OperatorContext.java:528)
	at org.esa.snap.core.gpf.internal.OperatorContext.getTargetProduct(OperatorContext.java:298)
	at org.esa.snap.core.gpf.Operator.getTargetProduct(Operator.java:359)
	at org.esa.snap.core.gpf.graph.NodeContext.initTargetProduct(NodeContext.java:77)
	... 32 more
Caused by: java.io.IOException: No valid orbit file found for 18-SEP-2024 05:26:03.766922
Orbit files may be downloaded from Copernicus Dataspaces 
and placed in /home/ubuntu/.snap/auxdata/Orbits/Sentinel-1/POEORB/S1A/2024/09
	at eu.esa.sar.orbits.io.sentinel1.SentinelPODOrbitFile.retrieveOrbitFile(SentinelPODOrbitFile.java:102)
	at eu.esa.sar.orbits.gpf.ApplyOrbitFileOp.updateOrbits(ApplyOrbitFileOp.java:247)
	at eu.esa.sar.orbits.gpf.ApplyOrbitFileOp.initialize(ApplyOrbitFileOp.java:193)
	... 36 more