Python, Miniconda, Jupyterlab & Python Packages

Python, Miniconda, Jupyterlab & Python Packages

Basic install

Open Ports Anaconda

In mydre.org, in tab: external access, add the following rules:

Rule & Description
IP-address
Port
conda.anaconda.org
104.17.93.24
443
repo.anaconda.com
104.16.131.3
443
docs.conda.io
188.114.96.7
443

ports might change, easy to check with a local computer: open cmd, ping <url>
  1. Open conda prompt in admin mode
  2. conda install -c conda-forge <package>

Install Miniconda

  1. download from: docs.conda.io/en/latest/miniconda.html
  2. Install as admin

Install Jupyterlab

  1. Open conda prompt in admin mode
  2. conda install -c conda-forge jupyterlab

Set default location to z: (optional)

This allows any user to quickly start Jupyter Labs from the desktop. All Jupyter Lab Notebooks are automatically created (and thus backuped as well) on the Z:-drive.  
  1. Create a folder on the Z:\Jupyter Labs
This is at the cost of a bit of performance for the Z-drive is not as fast ast the C-drive. Alternatively create a folder on the C:-drive and change after putting the shortcut on the desktop in the properties of the shortcut the target and start-in
  1. Download python.zip and upload it to the Workspace
  2. Extract the zip
  3. Put the shortcut in: c:\users\public\desktop  (just type desktop behind public)
  4. Put the icon in %ALLUSERSPROFILE%\Miniconda3\Menu\

Useful commands / packages

  1. Open conda prompt in admin mode

Updates

  1. conda update -c conda-forge jupyterlab
  2. conda update -c conda-forge --all
  3. conda update -c conda-forge python

Interesting packages

  1. Tabulate: conda install -c conda-forge tabulate
  2. OpenPyXL: conda install -c conda-forge openpyxl
  3. numpy: conda install -c conda-forge numpy
  4. pandas: conda install -c conda-forge pandas
  5. matplotlib: conda install -c conda-forge matplotlib
  6. seaborn: conda install -c conda-forge seaborn
  7. Castor: conda install -c conda-forge castorapi
** you can install multiple packages in one go like: conda install -c conda-forge tabulate seaborn castorapi

Jupyter Lab and multiprocessing

Cell 1
  1. %%writefile magic_functions.py
  2. def your_function(f):
  3.     return f

  5. def process_frame(f):
  6.     return f, study_check_v3(f)
Cell2
  1. from tqdm import tqdm
  2. from multiprocessing import Pool
  3. from magic_functions import process_frame

  5. frames_list = [x + batch*y for x in range(0, batch)]
  6. with Pool() as p:
  7.     pool_outputs = list(
  8.         tqdm(
  9.             p.imap(process_frame, frames_list),
  10.             total=len(frames_list)))

  12. print(pool_outputs)
  13. new_dict = dict(pool_outputs)
  14. print("dict: ", new_dict)


    • Related Articles

    • Using Castor in Python

      Introduction anDREa would like to thank Reinier van Linschoten for bringing this package and description to our attention. This is a Python package for interacting with the API of Castor Electronic Data Capture (EDC). The package contains functions ...

    • Installing R and Bioconductor packages

      Recently some users experienced issues with accessing R-packages and Bioconductor-packages. The article R and RStudio has been rewritten in order to easily install R and Bioconductor-packages in your Workspace.

    • CBS OpenData

      Access To access CBS OpenData from within your Workspace: Add External rule Rule name IP-address Port Remark opendata.cbs.nl 87.213.43.244 443 opendata.cbs.nl Turn on the rule Python & CBS OpenData Download cbsodata....whl from ...

    • CEDAR

      CEDAR Home page CEDAR https://more.metadatacenter.org/tools-training/orientation CEDAR APIs https://more.metadatacenter.org/tools-training/cedar-api CEDAR API and Python Prerequisites: Create file called: secret.py Add the following line of ...

    • Windows-OSDS/1.0.0 Open Source Data Science

      Windows-OSDS/1.0.0 Open Source Data Science VM template OS Windows Server 2019 Web browsers Chrome (default) Default download location: request  Microsoft Edge Utilities Notepad++: 7.9.5 Set as default according Notepad++ Z-zip Post VM creation ...