<div dir="ltr">Hi Tom,<div><br></div><div>understood. It is definitely something we should put on a wish list (I has rsynch in an out of Sciserver).</div><div><br></div><div>But with all these things there is also security implications of course, plus of course a container does not necessarily get a public IP address....</div><div><br></div><div>Max</div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Oct 20, 2020 at 6:08 PM Tom Dwelly <<a href="mailto:dwelly@mpe.mpg.de">dwelly@mpe.mpg.de</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Hi Max,<br>
<br>
yes I have been using the web-based terminal interface already. Unfortunately the subtle differences between that <br>
interface and the 'real' terminal I'm used to are a bit of a barrier. But it's only day one of trying this out, so maybe <br>
my muscle memory will give in eventually. I'm investigating firefox extensions that will enable 'normal' linux-like copy <br>
and paste operations in the web-terminal.<br>
<br>
However, I was mainly interested in the additional functionality that would be enabled by being able to pipe stuff in <br>
and out of a sciserver container via an ssh tunnel. But it sounds like that's not possible. Oh well, there are other routes.<br>
<br>
Cheers,<br>
<br>
Tom<br>
<br>
<br>
<br>
On 20/10/2020 15:53, Maximilian Fabricius wrote:<br>
> Hi Tom,<br>
> <br>
> (good to hear from you virtually again)<br>
> <br>
> ... and you do know that there is a terminal interface in SciServer, right?<br>
> <br>
> Max<br>
> <br>
> <br>
> <br>
> On Tue, Oct 20, 2020 at 3:57 PM Jonas Haase <<a href="mailto:jhaase@mpe.mpg.de" target="_blank">jhaase@mpe.mpg.de</a> <mailto:<a href="mailto:jhaase@mpe.mpg.de" target="_blank">jhaase@mpe.mpg.de</a>>> wrote:<br>
> <br>
> Oh dear I never saw Tom’s original mail, appareantly mailing list owners are not automativally subscribers….<br>
> <br>
> Let me anwer now!<br>
> <br>
>> On 20. Oct 2020, at 14:51, Johannes Buchner <<a href="mailto:jbuchner@mpe.mpg.de" target="_blank">jbuchner@mpe.mpg.de</a> <mailto:<a href="mailto:jbuchner@mpe.mpg.de" target="_blank">jbuchner@mpe.mpg.de</a>>> wrote:<br>
>><br>
>> On 19.10.20 14:58, Tom Dwelly wrote:<br>
>>> Hi Jonas<br>
>>><br>
>>> I have a few questions about using the MPE SciServer system. I am<br>
>>> sending this to the list in case any of these issues have been<br>
>>> encountered by other users.<br>
>>> Apologies for where I have got the SciServer nomenclature wrong.<br>
>>><br>
>>><br>
>>> 1) Is it possible to ssh from an external machine into a container<br>
>>> session running on SciServer compute?<br>
>><br>
>> This would make SciServer many times more attractive to use for me.<br>
>><br>
> <br>
> It is not possible to enter a interactive container that way no, however you can use the SciServer Python API to do<br>
> interactive work on your machine using the resources on the SciServer (database, file sharing) and you can also use<br>
> it to launch compute jobs, so running your software inside a new container.<br>
> <br>
> The MPE version of it is here:<br>
> <a href="https://github.com/jonashaase/SciScript-Python" rel="noreferrer" target="_blank">https://github.com/jonashaase/SciScript-Python</a><br>
> <br>
> I put some small example at the end of the getting started document<br>
> <a href="https://datashare.mpcdf.mpg.de/s/1e0CF3yRNcgDL4V" rel="noreferrer" target="_blank">https://datashare.mpcdf.mpg.de/s/1e0CF3yRNcgDL4V</a><br>
> And there is a example usage file with the code as well.<br>
> Admittedly a lot of it could be made more userfriendly...<br>
> <br>
>> Cheers,<br>
>> Johannes<br>
>><br>
>>> 2) Is there any way for a user to set up persistent settings (e.g.<br>
>>> .bashrc file, ssh settings etc) that are sourced/used by new terminal<br>
>>> sessions within any compute container?<br>
>>><br>
> <br>
> You can change .bashrc and everything else the idies user has access to and it should stay the same as long as the<br>
> container is not deleted. However as soon as you start a new container that will all be gone since /home/idies gets<br>
> re-built from the original image.<br>
> <br>
> Only the volumes mounted inside /home/idies/workspace/ are persistent, so you could of course source a setup scrip<br>
> inside your user volume which sets the environment in a way you like.<br>
> <br>
> I am of course happy to adjust the compute images to set up the environment better. I am sure I missed a few things,<br>
> in particular in connection with the x-ray software.<br>
> <br>
>>> 3) Is it possible for users to install standard linux packages (e.g. via<br>
>>> apt) within a container session?<br>
>>><br>
> <br>
> apt-get not, but conda and pip work.<br>
> <br>
> The reason is that we enforce that the user in the container is ‘idies’ and not root as it most often is in a Docker<br>
> container.<br>
> Its mostly a security issue: We don’t want anyone with root to be able to write onto the mounted disks on the<br>
> underlying system and somehow launch a escalation attack there.<br>
> <br>
>>> 3a) if not, please can you add emacs to the default list of installed<br>
>>> packages in the standard SciServer compute image?<br>
>>><br>
> <br>
> absolutely, no problem!<br>
> <br>
> @everyone: Please let me know if any software or libraries you need are missing and I’ll install them as quickly as<br>
> possible.<br>
> <br>
> <br>
>>><br>
>>> 4) Any idea why 'git clone' operations like the following are failing<br>
>>> within a compute container?<br>
>>><br>
> <br>
> unfortunately not, this should work.<br>
> I will look into it!<br>
> <br>
> <br>
> cheers<br>
> Jonas<br>
> <br>
> —<br>
> Jonas Haase<br>
> Max Planck Institute for Extraterrestrial Physics (MPE)<br>
> Giessenbachstr. 1, 85748 Garching, Germany<br>
> X5 1.3.08<br>
> +49 89 30000 3706<br>
> <br>
> -- <br>
> Sciserver-users mailing list<br>
> <a href="mailto:Sciserver-users@lists.mpe.mpg.de" target="_blank">Sciserver-users@lists.mpe.mpg.de</a> <mailto:<a href="mailto:Sciserver-users@lists.mpe.mpg.de" target="_blank">Sciserver-users@lists.mpe.mpg.de</a>><br>
> <a href="https://lists.mpe.mpg.de/cgi-bin/mailman/listinfo/sciserver-users" rel="noreferrer" target="_blank">https://lists.mpe.mpg.de/cgi-bin/mailman/listinfo/sciserver-users</a><br>
> <br>
> <br>
> <br>
> -- <br>
> --------------------------------------------------------------------<br>
> Maximilian Fabricius<br>
> * Max Planck Institute for Extraterrestrial Physics (MPE)<br>
> Giessenbachstrasse, D-85748 Garching, Germany<br>
> eMail: <a href="mailto:mxhf@mpe.mpg.de" target="_blank">mxhf@mpe.mpg.de</a> <mailto:<a href="mailto:mxhf@mpe.mpg.de" target="_blank">mxhf@mpe.mpg.de</a>><br>
> Phone: +49 89 30000 3712<br>
> --------------------------------------------------------------------<br>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div>--------------------------------------------------------------------</div><div> Maximilian Fabricius</div><div> * Max Planck Institute for Extraterrestrial Physics (MPE)</div><div> Giessenbachstrasse, D-85748 Garching, Germany<br> eMail: <a href="mailto:mxhf@mpe.mpg.de" target="_blank">mxhf@mpe.mpg.de</a><br> Phone: +49 89 30000 3712<br>--------------------------------------------------------------------</div></div></div></div></div></div></div></div></div></div></div>