Queued: The job has...
 
Notifications
Clear all

Queued: The job has been queued to run. It will run once a landing Zone is available. + How to generate a Dockerfile?  

 
Jens
 Jens
(@jens)
Member

Hi,

I am new an do not quite understand how that works.

I tried to upload your examples to run.

At the beginning it did and I could download the results.

 

But now I always get the message:

Queued: The job has been queued to run. It will run once a landing Zone is available. (see attachment)

 

What does it mean? and when will it be available? Can I influence that?

 

The second problem is that I do not understand how to generate a dockerfile from my jupyter-notebook (created from mini-conda as well as from Docker).

How do I generate it?

 

And I also tried to use your Docker Wizard, but it does not work. Even with your example files.

 

I was hoping for more documentation or at least some helpful post in the forum.

But since I couldn't find many activities, I am wondering if this application is still active?

 

regards,

Jens

 

Quote
Posted : 10/08/2020 1:17 am
Matthew
(@matthew)
Member Admin

Hi Jens, 

Thanks for the message. Jobs are placed in a queue and are run in the order they are submitted. Sometimes there is a delay before a job starts if a lot of users are submitting jobs simultaneously. 

I am happy to help you with the Dockerfile if you send me an example. If you post it here or email a .zip, I will have a look. We are working on improving the forum and documentation. 

Best,

Matt

ReplyQuote
Posted : 11/08/2020 6:10 pm
Jens
 Jens
(@jens)
Member

@matthew

Hi Matt,

thanks for your answer.

is there a way to see how long it takes until my job is getting processed?

The problem I have is, that I do some try-and-error things.

I want to try step by step how to get my Jupyter Notebook (Python) and my data (some GB of images) into the Station to run.

To do that, I wanted to start with a small example and create the Dockerfile myself.

Since it will probably take many corrections until the dockerfile and python file work probably, I need a way to test if it is correct and get feedback on what the problem is.

But when I have to wait for hours or days between any change and test it probably will take me weeks or months until it works.

So is there any way to test it fast (seconds)?

And is there a step by step tutorial for go from jupyter-notebook (python) to run it on Galileo?

 

And is there any way to generate a dockerfile or parts of it from Jupyter-Notebook or so?

 

Has anyone tried to use the provided examples without the dockerfile and instead us the docker wizard instead?

Is it really working? I remember I tried it many times but it didn't work. I think I got some errors.

 

Best,

Jens

ReplyQuote
Posted : 11/08/2020 10:58 pm
Matthew
(@matthew)
Member Admin

Hi @jens

Thanks for the message. At the moment, Galileo is still in an open beta phase, so we cap the amount of free resources. If you find your job is in the queue, it's because all available slots in the free resources are occupied. This limitation will go away soon. 

The first step to get your Jupyter Notebook project running is to explicitly save it as a .py file so Jupyter converts it for you. Next, add it to a folder with a Dockerfile, and your data. You can look at our Python tutorial to get a sense of how this works. 

https://galileoapp.io/gettingstarted/tutorial-python/

The next step, is to test the custom project locally. I put together a custom post on this:

https://galileoapp.io/forum/general/testing-custom-projects-locally-and-deploying-them-to-galileo/#post-23

I would encourage you to test locally first. Alternatively, you can drop the folder into Galileo without a Dockerfile and use the Docker Wizard to create one, which will automatically be added to your "Mission" with the files you uploaded.

I hope this answered your questions. Please let me know if I can clarify anything. 

Best, 

Matthew

ReplyQuote
Posted : 14/08/2020 8:02 pm