检查点/恢复微会议记录

（笔记的备份在这里http://criu.org/LPC2015_Checkpoint_Restore_notes）

Welcome to Linux Plumbers Conference 2015

The structure will be short introductions to an issue or topic followed by a discussion with the audience.

A limit of 3 slides per presentation is enforced to ensure focus and allocate enough time for discussions.

Please use this etherpad to take notes. Microconf leaders will be giving a TWO MINUTE summary of their microconference during the Friday afternoon closing session.

Please remember there is no video this year, so your notes are the only record of your microconference.

Miniconf leaders: Please remember to take note of the approximate number of attendees in your session(s).

SCHEDULE

Checkpoint and Restore of processes within kernel security mechanisms

Tycho Andersen of Canonical, CRIU contributor
- CRIU port to ARM
- support for AppArmor, other LSMs need help but framework exists
- integration of CRIU with seccomp
- cgroup port to usernsd and unified heirarchy: come help!
Question: is there a mechanism/plugin/whatever to migrate a container that is tied to a FPGA or a GPU, so they should be migrated together?
Answer: yes, there is a tool for it.

CRIU in HPC

Adrian Reber, an old-time CRIU contributor, RedHat
- research project in a university involving CRIU, started in 2009
- usage scenario: computer simulation for product develpment
- many nodes, many fails, need for a fail-tolerant HPC
- hypervisor is not the best virtualization type for HPC due to CPU & I/O overhead
- looked into BCLR (Berkeley Lab Checkpoint/Restart)
- requirements to C/R: upstream integration
- there were different attempts to implement C/R: see also: http://criu.org/Comparison_to_other_CR_projects
- key features of CRIU project: upstream inclusion, transparent solution wo pre-loading or re-compilation, most functionality in userspace, using standard interfaces as much as possible
- summary: transparent migration works, OpenMPI supports CRIU
(but keeps breaking as OpenMPI moves forward very fast), Parallel migration has WIP status

CRIU on PowerPC

Laurent Dufour, ported CRIU to PowerPC architecture, IBM
CRIU 1.6 ported on Power this summer (What did you do this summer? I ported CRIU to PowerPC).
- Linux kernel was ported to PowerPC arch in 1994 (See http://gate.crashing.org/doc/ppc/doc003.htm)
- Big Endian/Little Endian. PowerPC supports both.
- CRIU support only LE mode
- Laurent tell about mess in Linux kernel ABI: two ABI currently in kernel
- impacts: enabling kcmp() syscall, VDSO remapping tracking (both are available since 4.2)
- There is a general problem with checkpointing / restoring whilst in vDSO. It is possible to end up with two (old and new) entry points and there is currently no way to detect this.
- The vector register save/restore can get confused in some rare signal call stack cases. Fixing this is in the todo list.
- A hindrance to getting docker up and running in CRIU/ppc is that the images it downloads at build/startup are x86_64 images. Help requested.

Docker 中对本地检查点和还原的 CRIU 支持

Saied Kazemi，在谷歌从事容器迁移工作
- Docker C/R 的简短历史
- C/R 好处：CRIU 允许在容器内保存工作，缩短启动时间，使用检查点“iage”进行调试
- 用于 node.js 的新基于 Web 的 REPL - Tonic ( https://www.npmjs.com/package/tonic )。检查点每个步骤以通过从最近的更改恢复来修复错误。
- 带有 Docker 客户端、服务器和容器的演讲者展示方案并解释它是如何工作的
- Docker 的外部 C/R：Docker 中 C/R 容器的四个步骤
- 使用 Docker Container 的 C/R 进行现场演示 - 看起来令人印象深刻
-使用此方法手动 C/R'ing 会使 'docker ps' 无法显示容器
- TODO 列表可在CRIU下的 Doc ker 的 wiki上找到
- C/R 后损坏的东西：日志记录不起作用，容器控制丢失（docker stop，docker kill 等）
- Docker 1.5 中的原生 C/R（当前版本为 1.8 - https://blog.docker.com/2015/08/docker-1-8-content-trust-toolbox-registry-orchestration/）
- 在 libcontainer (runC) 中已经支持 C/R - Quake 的现场演示http://blog.kubernetes.io/2015/07/how-did-quake-demo-from-dockercon-work.html
- 有用的链接：CRIU PPA；GitHub: 1.5 ( https://github.com/SaiedKazemi/docker ) Saied Kazemi, 1.8 - Ross Bucher, current - M ichael Crosby docker git branch

来自 2014 年 Docker 聚会的幻灯片https://speakerdeck.com/saied/experimental-docker-checkpoint-and-restore-with-criu

休息 (2:45 - 3:00)

P.Haul：使用 CRIU 进行实时迁移

帕维尔·埃梅利亚诺夫（Pavel Emelyanov），身穿红色 T 恤，带麦克风
- Process-Haul（类似于U-Haul ，但关于流程）参见http://criu.org/P.Haul
- CRIU 是容器实时迁移解决方案的一部分
- 实时迁移的 CRIU 部分：执行节点兼容性检查，循环预转储，如果不共享则复制 fs，不要忘记容器配置
- P.Haul 迁移容器是两个步骤
- 关于 P.Haul 的更多信息：用 Python 编写，源代码https://github.com/xemul/p.haul/，可以迁移 OpenVZ 容器（How-to https://github.com/xemul/p.haul /blob/master/test/mtouch/HOWTO )，在 chroot-ed 容器上调用 rsync
- P.Haul 未来：Docker/LXC 支持、更智能的交互、共享 FS 自动检测、复制后实时迁移、通过网络发送图像 (CRIU)
-开始讨论 P.Haul

LXC 有类似的概念，但略有不同。关于如何合并似乎很容易达成共识（它只需要编码工作）。
Predump 允许进程继续运行，而完全转储是冻结
- - - - - KUP：使用 C/R 更新应用程序
        - CRIU 可用于比较类似项目
        - KUP 每个阶段的机会：检查点 -> 增量，恢复 -> 按需，C/R -> 新抽象
        - 重新启动时重用应用程序的内存
        - 内存重用：PPP (Persistent Physical Pages)
        - 评估每种技术的性能
        - 评估：KUP vs kpatch
        - 评估：memcached 的端到端性能
        - 评估：微基准
        - 结论：实现对页面缓存、hugepages 的原生支持；使用 usefaultd 按需恢复；需要大修kexec
        Using CRIU for Computer Architecture and Software Studies
        Christopher Covington, specialist in performance analysis and simulation at Qualcomm, http://covlibre.net/
        - speaker starts from terminology, it seems talk will be quite technical :P zOMG a technical talk? Isn't it a sales conference?? (it was a joke :) ) (I'll buy two) Take three and get a 25% discount!
        - Counting instructions seems preferable to counting time in order to gain determinancy of elapsed work performed.
        - Useful trick of dumping after zero instructions to gather an image complete with file descriptors, environment, etc, as startup conditions
CRIU project wiki: http://criu.org/ || Google+ page: https://plus.google.com/+CriuOrg || Twitter: @__criu__ https://twitter.com/__criu__
- - - - >>> anyone can write to etherpad, please help us filling in the notes <<<
        _____ _____ _____ _ _ _____ ____ _____ _ __ _____

Rebootless Kernel Update and its verification

Sanidhya Kashyap, PhD student (Georgia Institute of Technology) and CRIU contributor http://www.cc.gatech.edu/~skashyap/
- types of OS update with low downtime: dynamic kernel patching (KSplice, Kpatch and Kgraft)
- scheme with typical OS update
- KUP: update with C/R of applications
- CRIU benefits to compare similar projects
- opportunities in each phase of KUP: checkpoint -> incrementally, restore -> on-demand, C/R -> new abstraction
- reusing memory of application across reboot
- memory reuse: PPP (Persistent Physical Pages)
- evaluation of each techniques performance
- evaluation: KUP vs kpatch
- evaluation: end-to-end performance of memcached
- evaluation: microbenchmark
- Conclusion: implement native support for page cache, hugepages; on-demand restore with usefaultd; need to overhaul kexec

Using CRIU for Computer Architecture and Software Studies

Christopher Covington, specialist in performance analysis and simulation at Qualcomm, http://covlibre.net/
- speaker starts from terminology, it seems talk will be quite technical :P zOMG a technical talk? Isn't it a sales conference?? (it was a joke :) ) (I'll buy two) Take three and get a 25% discount!
- Counting instructions seems preferable to counting time in order to gain determinancy of elapsed work performed.
- Useful trick of dumping after zero instructions to gather an image complete with file descriptors, environment, etc, as startup conditions

CRIU project wiki: http://criu.org/ || Google+ page: https://plus.google.com/+CriuOrg || Twitter: @__criu__ https://twitter.com/__criu__

- - - - >>> anyone can write to etherpad, please help us filling in the notes <<<
        _____ _____ _____ _    _   _____   ____   _____ _ __ _____
        / ____| __ \|_   _| | | | | __ \ / __ \ / ____| |/ // ____|
        | |    | |__) | | | | | | | | |__) | | | | |    | ' /| (___
        | |    | _ / | | | | | | | _ /| | | | |    | < \___ \
        | |____| | \ \ _| |_| |__| | | | \ \| |__| | |____| . \ ____) |
        \_____|_| \_\_____|\____/ |_| \_\\____/ \_____|_|\_\_____/
        
        
                               `       ,
               .              `       ,+.
                +         .+'        '+'+
               +;+;       `         ++++:+
              :.++++     :   +     ;+++++
               ++++++    ;   +    `++++++'
              +++++++'   ,        ++++++++
               :++++++'   +      +++++++,
               :'+++++++ +;    ++++++++:
               ++++++++++ `+: `++++++':.
                +;+'+++++ ++, '+++++'+.
                 +;+;+++++ ++.+++++ +
                   ,+:;++++,+++++ :
                    .   :++++++'
                          ,.+++
                           ++;
                          +,
                        .`   ;+
                      .++ .+++ ++'`++ ++ ,++ '+'
                  +++++++; ++   ++. +; ++ :++ ++,
                  :++++++ ++   ++'+. ++ '+: ++`
                .;.+++++. +'   ++     ++ ++   ++
              .'`..:., +` +'   ++`++ ++ ++   ++
             `;. .,. `:   ++ . ++ +; ++ ++   ++
             ., .,,. ..   +++' ++ ++ ++ ++,,,++
             .. .;:...;`   ``          +    ,+,
             `,...;.;,`                      +
              ,...+........,:,...     ,      +
              ..'+';'++':.......,+:. .
             ..'...+.......... `.++'.
             ....,...;+++''+++.`.;+'.
             .+. ...........':: ....
             .,` ,:................
            ....` ..''.....```, ..
            ..+'.     ...',..`   .
            ..++.       ..++..
            ..+'.`     `..+++.
             .....      ..+++.
                        `.'+'.
                          .'
                          .`
                          `

搜索
复制
复制
搜索
复制
搜索
复制
搜索
复制
搜索
复制
第自动鉴定中文(简)中文(香港)中文(繁体)语三星银幕银幕银语银幕塞拜拜拜语银幕世界疆疆语阿疆丹麦比利时加泰隆世界疆语捷克语捷克语维埃埃希腊语希腊语沙尼亚语语法斯语语法芬兰语吉语加里语语爱尔兰语爱尔兰语印巴语爱尔兰语爱尔兰语演讲美拉语孔语爱尔兰语西亚语西亚尼亚语爱尔兰爱尼亚尼亚语哈萨克语语语拉语北语陶语陶语尔语亚吉语吉尔语民语亚耳语吉尔语家语家语家语家语家语旁语拉语脱语摩斯语斯·格拉斯·洛语斯洛伐克语斯语斯洛语阿尔巴语阿尔巴语斯瓦里别克语斯尼亚语乌拉尼亚语乌语泰米尔语泰塔加茨尼亚语班图祖自动语中文(简体)香港)中文(繁体)中文(繁体)中文(繁体) 比利时广播鲁泰鲁泰中文(繁体)中文(繁体) 比利时广播鲁泰鲁泰语(繁体) 中文(繁体)斯语沙语爱尔兰语爱尔兰语爱丝语古吉特加语爱尔兰语印西亚语语言亚尼亚语爱尔兰语话美莎莎莎拉卡波兰语波兰语波兰语拉语亚语巴语斯语塔语塔语斯洛文尼亚语阿尔摩尼亚语斯瓦语斯加语斯瓦语斯洛文斯·洛文尼亚语·阿尔摩语斯加语斯瓦语加语·洛文尼亚语·阿尔尼亚语都语乌兹别兹语越南语班图语祖鲁语翻译谷歌翻译谷歌翻译（国内）朗读复制正在查询，请稍候…… 重试朗读复制复制朗读复制谷歌译文

检查点/恢复微会议记录

Welcome to Linux Plumbers Conference 2015

The structure will be short introductions to an issue or topic followed by a discussion with the audience.

A limit of 3 slides per presentation is enforced to ensure focus and allocate enough time for discussions.

Please use this etherpad to take notes. Microconf leaders will be giving a TWO MINUTE summary of their microconference during the Friday afternoon closing session.

Please remember there is no video this year, so your notes are the only record of your microconference.

Miniconf leaders: Please remember to take note of the approximate number of attendees in your session(s).

SCHEDULE

Checkpoint and Restore of processes within kernel security mechanisms

CRIU in HPC

CRIU on PowerPC

Docker 中对本地检查点和还原的 CRIU 支持

P.Haul：使用 CRIU 进行实时迁移

Using CRIU for Computer Architecture and Software Studies

Christopher Covington, specialist in performance analysis and simulation at Qualcomm, http://covlibre.net/

- speaker starts from terminology, it seems talk will be quite technical :P zOMG a technical talk? Isn't it a sales conference?? (it was a joke :) ) (I'll buy two) Take three and get a 25% discount!

- Counting instructions seems preferable to counting time in order to gain determinancy of elapsed work performed.

- Useful trick of dumping after zero instructions to gather an image complete with file descriptors, environment, etc, as startup conditions

CRIU project wiki: http://criu.org/ || Google+ page: https://plus.google.com/+CriuOrg || Twitter: @__criu__ https://twitter.com/__criu__

>>> anyone can write to etherpad, please help us filling in the notes <<<

Rebootless Kernel Update and its verification

Using CRIU for Computer Architecture and Software Studies

CRIU project wiki: http://criu.org/ || Google+ page: https://plus.google.com/+CriuOrg || Twitter: @criu https://twitter.com/criu